Browsing or Searching User Interfaces and Other Aspects

ABSTRACT

User interfaces for browsing and/or searching are described. In one embodiment, a method includes displaying a first display area for display representations of documents matching a search query, the first display area configured to display content of the documents which can have a plurality of different types of content including at least one of text-based content and a folder, and displaying a second display area for selecting a selected document to be displayed in the first display area. Other embodiments are also described, and computer readable media and apparatuses are also described.

BACKGROUND OF THE INVENTION

Modern data processing systems, such as general purpose computersystems, allow the users of such systems to create a variety ofdifferent types of data files. For example, a typical user of a dataprocessing system may create text files with a word processing programsuch as Microsoft Word or may create an image file with an imageprocessing program such as Adobe's PhotoShop. Numerous other types offiles are capable of being created or modified, edited, and otherwiseused by one or more users for a typical data processing system. Thelarge number of the different types of files that can be created ormodified can present a challenge to a typical user who is seeking tofind a particular file which has been created.

Modern data processing systems often include a file management systemwhich allows a user to place files in various directories orsubdirectories (e.g. folders) and allows a user to give the file a name.Further, these file management systems often allow a user to find a fileby searching for the file's name, or the date of creation, or the dateof modification, or the type of file. An example of such a filemanagement system is the Finder program which operates on Macintoshcomputers from Apple Inc. of Cupertino, Calif. Another example of a filemanagement system program is the Windows Explorer program which operateson the Windows operating system from Microsoft Corporation of Redmond,Wash. Both the Finder program and the Windows Explorer program include afind command which allows a user to search for files by various criteriaincluding a file name or a date of creation or a date of modification orthe type of file. However, this search capability searches throughinformation which is the same for each file, regardless of the type offile. Thus, for example, the searchable data for a Microsoft Word fileis the same as the searchable data for an Adobe PhotoShop file, and thisdata typically includes the file name, the type of file, the date ofcreation, the date of last modification, the size of the file andcertain other parameters which may be maintained for the file by thefile management system.

Certain presently existing application programs allow a user to maintaindata about a particular file. This data about a particular file may beconsidered metadata because it is data about other data. This metadatafor a particular file may include information about the author of afile, a summary of the document, and various other types of information.A program such as Microsoft Word may automatically create some of thisdata when a user creates a file and the user may add additional data oredit the data by selecting the “property sheet” from a menu selection inMicrosoft Word. The property sheets in Microsoft Word allow a user tocreate metadata for a particular file or document. However, in existingsystems, a user is not able to search for metadata across a variety ofdifferent applications using one search request from the user.Furthermore, existing systems can perform one search for data files, butthis search does not also include searching through metadata for thosefiles.

SUMMARY OF THE DESCRIPTION

Methods for managing data in a data processing system and systems formanaging data are described herein.

A method of managing data in one exemplary embodiment includesdisplaying a first display area for displaying two-dimensional (2-D)representations of documents matching a search query, the first displayarea configured to display content of the documents which can have aplurality of different types of content including at least one oftext-based content and a folder, and the method further includesdisplaying a second display area for selecting a selected document to bedisplayed in the first display area. In at least certain embodiments,the content of the selected document can be zoomed from the firstdisplay area to display an enlarged view or may be presented as multiplepages which are selectable such that the document can be viewed one pageat a time or several pages at a time. In certain embodiments, the firstdisplay area and the second display area are adjacent each other in thesame moveable, closeable, resizeable and minimizeable window, whichincludes user interface objects to receive user inputs to move thewindow, close the window, resize the window, maximize the window andminimize the window. Further, the window may include various userinterface objects which allow the user to pick between different views,including a view which includes the first display area and the seconddisplay area. In at least certain embodiments, the first display areamay be referred to as a “cover flow” view area and the second displayarea may be referred to as a “list display” view area. In at leastcertain embodiments, the method may include the performance of a searchthrough metadata for various different kinds of documents, as well as anindex database which includes a full-text inverted database containingthe full text of the content of the documents within a data processingsystem. In certain embodiments, the documents may be organized andstored in a hierarchical file system, and a user interface program, suchas the Finder from Apple Inc. of Cupertino, Calif., or Windows Explorerfrom Microsoft of Redmond, Wash., may be provided to allow the user tomanage the location, etc. of the documents and files maintained by thehierarchical filing system (HFS).

In at least certain embodiments, a user may select a document in thelist view and this causes the documents in the cover flow view to scrollin order to show the same document in the selected document position ofa cover flow view. In certain embodiments, scrolling of the documents inthe cover flow view is linked to the scrolling of documents in the listdisplay view area such that scrolling in one area is matched by andcoordinated with scrolling in the other area. In at least certainembodiments, the list display view area displays at least a portion ofthe documents matching the search query, and the order of the documentsin the list view area matches the order of the documents shown in thecover flow view area which also shows documents matching the searchquery. The cover flow view area typically includes one set of documentson one side of the selected document and another set of documents on theother side of the selected document; the spacing between the documentsis not uniform. In at least certain embodiments, documents on the leftside of the selected document appear to be facing towards the right andtherefore towards the selected document, while documents on the rightside of the selected document appear to be facing towards the left sideand therefore towards the selected document. The apparent direction eachset of documents faces may be achieved by providing a perspective viewin which one side of the document is longer than another side of thedocument even though, in fact, the underlying document has sides thatare equal and parallel.

According to another aspect of the inventions described herein, a methodof managing data in one exemplary embodiment includes displaying a firstdisplay area for displaying two-dimensional representations of at leasta portion of files and folders in a hierarchical file system, the firstdisplay area configured to display content of the files in the firstdisplay area, and displaying a second display area for selecting aselected document to be displayed in the first display area, wherein thesecond display area displays the two-dimensional representations of atleast a portion of the files and folders in the hierarchical filesystem. In this method, the first display area and the second displayarea may be a cover flow view area and a list display view area,respectively, each of which are adjacent to each other in the samewindow which is moveable, resizeable, closeable, minimizeable, andmaximizeable. The window may include various user interface objectswhich allow a user to close, minimize, maximize, resize, or move thewindow. Further, the window may include user interface objects whichallow a user to input various commands for operating on the files in thehierarchical file system, such as commands to move a file in thehierarchical file system (HFS), or create a copy of the file in the HFS,or delete a file, or create a new folder in the HFS or move a folder inthe HFS or create a copy of the folder or delete the folder or move afile from a first folder to a second folder, etc. Each view area, suchas the cover flow view area and the list display view area, may includescroll control user interface objects, such as a scroll bar and scrollarrows for allowing the user to scroll the views in each display area.The scrolling may be linked or not linked depending on theimplementation.

According to another aspect of the inventions described herein, a methodof managing data in one exemplary embodiment includes displaying an iconof a folder, wherein the icon of the folder is at least partiallytransparent to show icons at least partially within the folder, anddisplaying a set of icons at least partially within the icon of thefolder. In at least certain embodiments, the icons may rotate within theicon of the folder to display, after a sufficient amount of rotating,all viewable files in the folder, and wherein the folder represents asubdirectory in a hierarchical file system. In at least certainembodiments, the set of icons are animated to display at least a subsetof the icons over a period of time. The set of icons may be animated byone of rotating, over time, the icons in the set of icons, or shuffling,over time, the icons in the set of icons, or displaying momentarily andsequentially each of the icons in the set of icons, etc. The icons inthe set of icons in the folder may be at least one of graphical imagesor thumbnails of content of files represented by the icons.

Another method of managing data in one exemplary embodiment includesdisplaying an icon of a folder which includes files represented by theicons, the files being in a hierarchical file system and displayingautomatically, without user interaction with the icon of the folder, ananimation presenting a content or representation of each of the files,wherein a subset of the files is shown after a sufficient period oftime. The animation may present the content or representation at leastpartially within the icon of the folder. The icon of the folder may ormay not be transparent and the animation may present the content orrepresentation on the face of the icon of the folder if the folder isnot transparent. The animation may be one of rotating, over time, thecontent or representation of each of the files or shuffling, over time,the content or representation of each of the files or other mechanismsfor displaying, over time, the various icons in the file.

According to another aspect of the inventions described herein, methodsand software architectures provide previews of files, such as previewsof content of the files without launching the applications which createdthose files. In one embodiment, a method includes receiving a firstcall, through a first application programming interface (API), to obtaina preview of content of a file, the first call being made by a firstapplication program and being received by a preview generator, such as apreview generator daemon which is provided by operating system software;and the method also includes generating a request (which may be a callthrough a second API) to obtain a first software routine, such as afirst plug-in, from a set of software routines, such as a set ofplug-ins which may be extensible, wherein the first plug-in isconfigured to process a file type of the file to produce content in aformat which can be displayed by the first application program. Thismethod allows, at least in certain embodiments, for previews of contentto be provided to the first application program for a wide variety ofdifferent file types (e.g. PDF, HTML, Visio, AutoCAD, PPT, DOC, text,XLS (Excel), JPG, and other file types noted herein, etc.) withoutrequiring that the applications which created these files be launched inorder to view the content. The first application program may be one of aset of programs including at least one user level program which use thismethod to present previews of content; for example, the firstapplication program may be a file management software program (e.g. theFinder from Apple Inc. or Windows Explorer from Microsoft) or a searchsoftware program (e.g. Spotlight from Apple Inc.) or an email softwareprogram or a calendar software program or an instant messaging softwareprogram or other software programs.

In at least certain embodiments, the first application program (e.g. theFinder or Spotlight) displays an initial preview of the file in a firstview which is one of a list view or an icon view or a cover flow viewand wherein the initial preview is not configured to be interactive,within the first view, in response to user inputs and wherein thecontent produced through the first plug-in is configured tointeractively display content of the file (e.g. page through or scrollthrough or browse through the content or zoom or resize the content orplayback the content, such as playback a movie) in response to userinputs. This interactive display of content may also occur in the firstview or zoom out from the first view or be layered over the first view.The first application program may also display, while displaying theinitial preview within the first view, other initial previews of otherfiles and data (e.g. data within a file such as an address informationwithin a contact/address book database) within the first view. Further,the interactive content displayed through the first plug-in may bedisplayed in the first view while the other initial previews are alsobeing displayed within the first view.

In at least certain embodiments, a method may further include generatinga second call to a file system program to obtain an identifier of thefile type of the file and receiving the identifier of the file type inresponse to the second call, wherein the identifier is used to selectthe first plug-in from the set of plug-ins.

In at least certain embodiments, the content produced through the firstplug-in is displayable by the first application program without furtherconversion of data; in other embodiments, the content produced throughthe first plug-in may be in a standard format (e.g. HTML, text, PDF,JPG) which can be processed through the first application to generatedisplayed content.

Software architectures are also described, and these may include apreview generator daemon which interfaces with applications (e.g.Finder) which make calls to the preview generator daemon through a firstapplication programming interface (API). The preview generator daemonmay, in response to those calls, request plug-ins to provide the contentof the files for a preview of that content without launching theapplications which created those files.

Other aspects of the present inventions include various data processingsystems which perform these methods and machine readable media whichcause a data processing system to perform various methods describedherein.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is illustrated by way of example and notlimitation in the figures of the accompanying drawings in which likereferences indicate similar elements.

FIG. 1 shows an exemplary embodiment of a data processing system, whichmay be a general purpose computer system and which may operate in any ofthe various methods described herein.

FIG. 2 shows a general example of one exemplary method of one aspect ofthe invention.

FIG. 3A shows an example of the content of the particular type ofmetadata for a particular type of file.

FIG. 3B shows another example of a particular type of metadata foranother particular type of file.

FIG. 4 shows an example of an architecture for managing metadataaccording to one exemplary embodiment of the invention.

FIG. 5 is a flow chart showing another exemplary method of the presentinvention.

FIG. 6 shows an example of a storage format which utilizes a flat fileformat for metadata according to one exemplary embodiment of theinvention.

FIGS. 7A-7E show a sequence of graphical user interfaces provided by oneexemplary embodiment in order to allow searching of metadata and/orother data in a data processing system.

FIGS. 5A and 8B show two examples of formats for displaying searchresults according to one exemplary embodiment of the invention.

FIG. 9 shows another exemplary user interface of the present invention.

FIG. 10 shows another exemplary user interface of the present invention.

FIGS. 11A-11D show, in sequence, another exemplary user interfaceaccording to the present invention.

FIGS. 12A-12D show alternative embodiments of user interfaces accordingto the present invention.

FIGS. 13A and 13B show further alternative embodiments of userinterfaces according to the present invention.

FIGS. 14A, 14B, 14C, and 14D show further alternative embodiments ofuser interfaces according to the present invention.

FIGS. 15A, 15B, 15C and 15D show another alternative embodiment of userinterfaces according to the present invention.

FIGS. 16A and 16B show certain aspects of embodiments of user interfacesaccording to the present invention.

FIG. 17 shows an aspect of certain embodiments of user interfacesaccording to the present invention.

FIGS. 18A and 18B show further aspects of certain embodiments of userinterfaces according to the present invention.

FIGS. 19A, 19B, 19C, 19D, and 19E show further illustrative embodimentsof user interfaces according to the present invention.

FIG. 20 is a flow chart which illustrates another exemplary method ofthe present invention.

FIG. 21 shows a method, according to one exemplary embodiment, ofanother aspect of the present inventions.

FIGS. 22A, 22B and 22C show examples of previews of items found from asearch query, with the previews being capable of being presented withinthe window showing the search results.

FIG. 23 is a flow chart which illustrates an exemplary method accordingto certain embodiments of the present invention which may include acover flow view.

FIGS. 24A-24G show examples of user interfaces for providing a coverflow view in the context of a software program for managing files in afile system, such as a hierarchical file system.

FIGS. 25A and 25B provide examples of a user interface for showing acover flow view to depict the results of a search of files and foldersin a hierarchical file system or other file system.

FIG. 26A is a flow chart which depicts an example of a method forinteracting with representations of documents shown in a cover flowview; the interaction may include zooming or paging through or scrollingthrough the documents shown in the cover flow view.

FIGS. 26B-26I provide examples of user interfaces for interacting withdocuments within a cover flow view according to at least certainembodiments of the present inventions.

FIGS. 27A-27N show examples of user interfaces for causing zooming inand out from a cover flow view of a document, such as a movie.

FIG. 28A is a flow chart showing an example of one method of animatingicons within a partially transparent folder.

FIG. 28B is a flow chart showing another example of an animation of anicon in a folder according to other embodiments of the presentinvention.

FIGS. 28C-28G provide examples of user interfaces showing one embodimentof animations of icons within a folder.

FIGS. 29A-29E show examples of animations on the cover of a folder.

FIGS. 30A-30E show examples of user interfaces for animating thumbnailsrepresenting files within at least a partially transparent folderaccording to certain embodiments of the present invention.

FIG. 31 shows an example of an architecture, which includes at least oneapplication program interface (API), that allows an application, such asa user level application, to obtain a preview of files and other datawithout having to launch another application which created that file orother data.

DETAILED DESCRIPTION

The subject invention will be described with reference to numerousdetails set forth below, and the accompanying drawings will illustratethe invention. The following description and drawings are illustrativeof the invention and are not to be construed as limiting the invention.Numerous specific details are described to provide a thoroughunderstanding of the present invention. However, in certain instances,well known or conventional details are not described in order to notunnecessarily obscure the present invention in detail.

The present description includes material protected by copyrights, suchas illustrations of graphical user interface images. The owners of thecopyrights, including the assignee of the present invention, herebyreserve their rights, including copyright, in these materials. Thecopyright owner has no objection to the facsimile reproduction by anyoneof the patent document or the patent disclosure, as it appears in thePatent and Trademark Office file or records, but otherwise reserves allcopyrights whatsoever. Copyright Apple Inc. 2007.

FIG. 1 shows one example of a typical computer system which may be usedwith the present invention. Note that while FIG. 1 illustrates variouscomponents of a computer system, it is not intended to represent anyparticular architecture or manner of interconnecting the components assuch details are not germane to the present invention. It will also beappreciated that personal digital assistants (PDAs), cellulartelephones, media players (e.g. an iPod), devices which combine aspectsor functions of these devices (e.g. a media player combined with a PDAand a cellular telephone in one device), an embedded processing devicewithin another device, network computers, a consumer electronic device,and other data processing systems which have fewer components or perhapsmore components may also be used with or to implement one or moreembodiments of the present invention. The computer system of FIG. 1 may,for example, be a Macintosh computer from Apple Inc.

As shown in FIG. 1, the computer system 101, which is a form of a dataprocessing system, includes a bus 102 which is coupled to amicroprocessor(s) 103 and a ROM (Read Only Memory) 107 and volatile RAM105 and a non-volatile memory 106. The microprocessor 103 may be amicroprocessor from Intel or a G3 or G4 microprocessor from Motorola,Inc. or one or more G5 microprocessors from IBM. The bus 102interconnects these various components together and also interconnectsthese components 103, 107, 105, and 106 to a display controller anddisplay device 104 and to peripheral devices such as input/output (I/O)devices which may be mice, keyboards, modems, network interfaces,printers and other devices which are well known in the art. Typically,the input/output devices 109 are coupled to the system throughinput/output controllers 108. The volatile RAM (Random Access Memory)105 is typically implemented as dynamic RAM (DRAM) which requires powercontinually in order to refresh or maintain the data in the memory. Themass storage 106 is typically a magnetic hard drive or a magneticoptical drive or an optical drive or a DVD RAM or other types of memorysystems which maintain data (e.g. large amounts of data) even afterpower is removed from the system. Typically, the mass storage 106 willalso be a random access memory although this is not required. While FIG.1 shows that the mass storage 106 is a local device coupled directly tothe rest of the components in the data processing system, it will beappreciated that the present invention may utilize a non-volatile memorywhich is remote from the system, such as a network storage device whichis coupled to the data processing system through a network interfacesuch as a modem or Ethernet interface. The bus 102 may include one ormore buses connected to each other through various bridges, controllersand/or adapters as is well known in the art. In one embodiment the I/Ocontroller 108 includes a USB (Universal Serial Bus) adapter forcontrolling USB peripherals and an IEEE 1394 controller for IEEE 1394compliant peripherals.

It will be apparent from this description that aspects of the presentinvention may be embodied, at least in part, in software. That is, thetechniques may be carried out in a computer system or other dataprocessing system in response to its processor, such as amicroprocessor, executing sequences of instructions contained in amemory, such as ROM 107, RAM 105, mass storage 106 or a remote storagedevice. In various embodiments, hardwired circuitry may be used incombination with software instructions to implement the presentinvention. Thus, the techniques are not limited to any specificcombination of hardware circuitry and software nor to any particularsource for the instructions executed by the data processing system. Inaddition, throughout this description, various functions and operationsare described as being performed by or caused by software code tosimplify description. However, those skilled in the art will recognizewhat is meant by such expressions is that the functions result fromexecution of the code by a processor, such as the microprocessor 103.

Capturing and Use of Metadata Across a Variety of Application Programs

FIG. 2 shows a generalized example of one embodiment of the presentinvention. In this example, captured metadata is made available to asearching facility, such as a component of the operating system whichallows concurrent searching of all metadata for all applications havingcaptured metadata (and optionally for all non-metadata of the datafiles). The method of FIG. 2 may begin in operation 201 in whichmetadata is captured from a variety of different application programs.This captured metadata is then made available in operation 203 to asearching facility, such as a file management system software forsearching. This searching facility allows, in operation 205, thesearching of metadata across all applications having captured metadata.The method also provides, in operation 207, a user interface of a searchengine and the search results which are obtained by the search engine.There are numerous possible implementations of the method of FIG. 2. Forexample, FIG. 5 shows a specific implementation of one exemplaryembodiment of the method of FIG. 2. Alternative implementations may alsobe used. For example, in an alternative implementation, the metadata maybe provided by each application program to a central source which storesthe metadata for use by searching facilities and which is managed by anoperating system component, which may be, for example, the metadataprocessing software. The user interface provided in operation 207 maytake a variety of different formats, including some of the examplesdescribed below as well as user interfaces which are conventional, priorart user interfaces. The metadata may be stored in a database which maybe any of a variety of formats including a B tree format or, asdescribed below, in a flat file format according to one embodiment ofthe invention.

The method of FIG. 2 may be implemented for programs which do not storeor provide metadata. In this circumstance, a portion of the operatingsystem provides for the capture of the metadata from the variety ofdifferent programs even though the programs have not been designed toprovide or capture metadata. For those programs which do allow a user tocreate metadata for a particular document, certain embodiments of thepresent invention may allow the exporting back of captured metadata backinto data files for applications which maintain metadata about theirdata files.

The method of FIG. 2 allows information about a variety of differentfiles created by a variety of different application programs to beaccessible by a system wide searching facility, which is similar to theway in which prior art versions of the Finder or Windows Explorer cansearch for file names, dates of creation, etc. across a variety ofdifferent application programs. Thus, the metadata for a variety ofdifferent files created by a variety of different application programscan be accessed through an extension of an operating system, and anexample of such an extension is shown in FIG. 4 as a metadata processingsoftware which interacts with other components of the system and will bedescribed further below.

FIGS. 3A and 3B show two different metadata formats for two differenttypes of data files. Note that there may be no overlap in any of thefields; in other words, no field in one type of metadata is the same asany field in the other type of metadata. Metadata format 301 may be usedfor an image file such as a JPEG image file. This metadata may includeinformation such as the image's width, the image's height, the image'scolor space, the number of bits per pixel, the ISO setting, the flashsetting, the F/stop of the camera, the brand name of the camera whichtook the image, user-added keywords and other fields, such as a fieldwhich uniquely identifies the particular file, which identification ispersistent through modifications of the file. Metadata format 331 shownin FIG. 3B may be used for a music file such as an MP3 music file. Thedata in this metadata format may include an identification of theartist, the genre of the music, the name of the album, song names in thealbum or the song name of the particular file, song play times or thesong play time of a particular song and other fields, such as apersistent file ID number which identifies the particular MP3 file fromwhich the metadata was captured. Other types of fields may also be used.The following chart shows examples of the various fields which may beused in metadata for various types of files.

Cop- User ied Item Parent in Multi- set- Get- with App name hierarchyAttribute name Description/Notes CFType value Localized table table copyviewable Item n/a Authors Who created or CFString Yes No Yes Yes YesAddress contributed to the Book contents of this item Comment A freeform text CFString No No Yes Yes Yes comment ContentType This is thetype that is CFString No ? No Yes Yes determined by UTI ContentTypesThis is the inheritance of CFString Yes ? No Yes Yes the UTI systemCreatedDate When was this item CFDate No No No Yes Yes createdDisplayName The name of the item as CFString No Yes Yes Yes Yes Finder(or the user would like to Launch read it. Very well may Services) bethe file name, but it may also be the subject of an e-mail message orthe full name of a person, for example. Keywords This is a list wordsset CFString Yes System- Yes Yes Ask by the user to identify providedarbitrary sets of keywords organization. The scope (if any) isdetermined by the user and can be flexibly used for any kind oforganization. For example, Family, Hawaii, Project X, etc. Contact Alist of contacts that CFString Yes No Yes Yes Ask Address Keywords areassociated with this Book document, beyond what is captured as Author.This may be a person who's in the picture or a document about a personor contact (performance review, contract) ModifiedDate When this itemwas last CFDate No No No Yes modified Rating A relative rating (0 to 5CFNumber No n/a Yes Yes value) on how important a particular item is toyou, whether it's a person, file or message RelatedTos A list of otheritems that CFString Yes No Yes Yes are arbitrarily grouped together.TextContent An indexed version of any CFString No No No Yes content textUsedDates Which days was the CFDate Yes No No Yes documentopened/viewed/played Content/ Item Copyright Specifies the owner of thisCFString No No Yes Yes Data content, i.e. Copyright Apple Inc.CreatorApp Keeps track of the CFString No ? No Yes application that wasused to create this document (if it's known). Languages The languagesthat this CFString Yes Yes Yes Yes document is composed in (for eithertext or audio- based media) ParentalControl A field that is used toCFString No ? Yes Yes determine whether this is kid-friendly content ornot Publishers The name or a person or CFString Yes No Yes Yes Addressorganization that published Book this content. PublishedDate Theoriginal date that this CFDate No No Yes Yes content was published (ifit was), independent of created date. Reviewers A list of contacts whoCFString Yes No Yes Yes Address have reviewed the contents Book of thisfile. This would have to be set explicitly by an application. Image DataReviewStatus Free form text that used CFString No ? Yes Yes to specifywhere the document is in any arbitrary review process TimeEdited Totaltime spent editing CFDate No No No Yes document WhereTos Where did thisgo to, eg. CFString Yes System- ? Yes CD, printed, backedup providedwords only (if any) WhereFroms Where did this come CFString Yes System-? Yes from, e.g. camera, email, provided web download, CD words only (ifany) BitsPerSample What is the bit depth of CFNumber No Yes the image(8-bit, 16-bit, etc.) ColorSpace What color space model CFString No YesColorSync is this document Utility? following ImageHeight The height ofthe image CFNumber No Yes in pixels ImageWidth The width of the imageCFNumber No Yes in pixels ProfileName The name of the color CFString NoYes ColorSync profile used with for Utility? image ResolutionWidthResolution width of this CFNumber No Yes image (i.e. dpi from a scanner)ResolutionHeight Resolution height of this CFNumber No Yes image (i.e.dpi from a scanner) LayerNames For image formats that CFString Yes Yescontain “named” layers (e.g. Photoshop files) Aperture The f-stop ratingof the CFNumber No Yes camera when the image was taken CameraMake Themake of the camera CFString No Yes Yes that was used to acquire thisimage (e.g. Nikon) CameraModel The model of the camera CFString No YesYes used to acquire this image (Coolpix 5700) DateTimeOriginal Date/timethe picture CFDate No Yes was taken ExposureMode Mode that was used forCFString No Yes the exposure ExposureTime Time that the lens was CFDateNo Yes exposed while taking the picture Flash This attribute is CFNumberNo Yes overloaded with information about red- eye reduction. This is nota binary value GPS Raw value received CFString No Yes from GPS deviceassociated with photo acquisition. It hasn't necessarily been translatedto a user- understandable location. ISOSpeed The ISO speed the CFNumberNo Yes camera was set to when the image was acquired Orientation Theorientation of the CFString No Yes camera when the image was acquiredWhiteBalance The white balance CFNumber No Yes setting of the camerawhen the picture was taken EXIFversion The version of EXIF CFString NoYes that was used to generate the metadata for the image Time- DataAcquisitionSources The name or type of CFString Yes Yes based devicethat used to acquire the media Codecs The codecs used to CFString YesYes encode/decode the media DeliveryType FastStart or RTSP CFString NoYes Duration The length of time that CFNumber No Yes the media lastsStreamable Whether the content is CFBoolean No Yes prepared for purposesof streaming TotalBitRate The total bit rate (audio CFNumber No Yes &video combined) of the media. AudioBitRate The audio bit rate of theCFNumber No Yes media AspectRatio The aspect ratio of the CFString NoYes video of the media ColorSpace The color space model CFString No Yesused for the video aspect of the media FrameHeight The frame height inCFNumber No Yes pixels of the video in the media FrameWidth The framewidth in CFNumber No Yes pixels of the video in the media ProfileNameThe name of the color CFString No Yes profile used on the video portionof the media VideoBitRate The bit rate of the video CFNumber No Yesaspect of the media Text Data Subject The subject of the text. CFStringNo Yes This could be metadata that's supplied with the text or somethingautomatically generated with technologies like VTWIN PageCount Thenumber of printable CFNumber No Yes pages of the document LineCount Thenumber of lines in CFNumber No Yes the document WordCount The number ofwords in CFNumber No Yes the document URL The URL that will get CFStringNo Yes you to this document (or at least did at one time). Relevant forsaved HTML documents, bookmarks, RSS feeds, etc. PageTitle The title ofa web page. CFString No Yes Relevant to HTML or bookmark documentsGoogle Structure of where this CFString No Yes Hierarchy page can befound in the Google hierarchy. Relevant to HTML or bookmark documentsCompound Data <Abstract> There are no specific n/a n/a n/a n/a n/a n/an/a document attributes assigned to this item. This is to catch allapp-specific file formats that fall within Data, but don't fit into anyof the other types. Typically these documents have multiple types ofmedia embedded within them. (e.g. P PDF Compound NumberOfPages Thenumber of printable CFNumber No Yes document pages in the documentPageSize The size of the page CFNumber No No Yes stored as pointsPDFTitle PDF-specific title CFString No ? Yes metadata for the documentPDFAuthor PDF-specific author CFString No ? Yes Address metadata for theBook document PDFSubject PDF-specific subject CFString No ? Yes metadatafor the document PDFKeywords PDF-specific keywords CFString Yes ? Yesmetadata for the document PDFCreated PDF-specific created CFDate No ?Yes metadata for the document PDFModified PDF-specific modified CFDateNo ? Yes metadata for the document PDFVersion PDF-specific versionCFString No ? Yes metadata for the document SecurityMethod Method bywhich this CFString No Yes document is kept secure Presentation CompoundSlideTitles A collection of the titles CFString Yes Yes (Keynote)document on slides SlideCount The number of slides CFString No YesSpeakerNotesContent The content of all the CFString ? Yes speaker notesfrom all of the slides together Application Item Categories The kind ofapplication CFString Yes Yes this is: productivity, games, utility,graphics, etc. A set list that Message Item Recipients Maps to To andCc: CFString Yes Yes Address addresses in a mail Book message. PriorityThe priority of the CFString No Yes message as set by the senderAttachmentNames The list of filenames that CFString Yes Yes representattachments in a particular message (should be actionable within theFinder) Authors maps to From address in CFString Yes No Yes Yes YesAddress mail message Book Comment Not applicable to Mail CFString No NoYes Yes Yes right now (should we consider?) ContentType CFString No NoYes Yes ContentTypes CFString Yes No Yes Yes CreatedDate When was thismessage CFDate No No No Yes Yes was sent or received DisplayName Subjectof the message CFString No Yes Yes Yes Yes Keywords There will be a wayto CFString Yes System- Yes Yes Ask set keywords within provided Mailkeywords (if any) Contact Could be where CFString Yes No Yes Yes AskAddress Keywords recipients are held Book ModifiedDate Not applicableCFDate No No No Yes Rating A relative rating (0 to 5 CFNumber No n/a YesYes stars) on how important a particular message is to you (separatefrom a message's Priority) RelatedTos Potentially threaded CFString YesNo Yes Yes messages could be put into this category TextContent Anindexed version of CFString No No No Yes the mail message UsedDates Theday/time in which CFDate Yes No No Yes the mail message was viewed/readContact Item Company The company that this CFString No Yes Addresscontact is an employee Book of E-mails A list of e-mail CFString Yes YesMail addresses that this contact has IMs A list of instant messageCFString Yes Yes iChat handles this contact has Phones A list of phonenumbers CFString Yes that relate to this contact Addresses A list ofphysical CFString Yes addresses that relate to this person Authors thename of the owner of CFString Yes No Yes Yes Yes Address the AddressBook Book (current user name) Comment CFString No No Yes Yes YesContentType CFString No No Yes Yes ContentTypes CFString Yes No Yes YesCreatedDate date the user entered this CFDate No No No Yes Yes into hisAddressBook (either through import or direct entry) DisplayNameComposite name of CFString No Yes Yes Yes Yes contact (First Name, LastName) Keywords There will be a way to CFString Yes System- Yes Yes Askset keywords within provided Address Book keywords (if any) ContactCFString Yes No Yes Yes Ask Address Keywords Book ModifiedDate Last timethis contact CFDate No No No Yes entry was modified Rating A relativerating (0 to 5 CFNumber No n/a Yes Yes stars) on how important aparticular contact is to you (separate from a message's Priority)RelatedTos (potentially could be CFString Yes No Yes Yes used toassociate people from the same company or family) TextContent An indexedversion of CFString No No No Yes the Notes section UsedDates Theday/time in which CFDate Yes No No Yes the contact entry was viewed inAddress Book Meeting Item Body text, rich text or CFString No Yes (TBD)document that represents the full content of the event Description textdescribing the event CFString No Yes EventTimes time/date the eventstarts CFDate Yes Yes Duration The length of time that CFNumber No Yesthe meeting lasts Invitees The list of people who CFString Yes YesAddress are invited to the Book meeting Location The name of thelocation CFString No Yes where the meeting is taking place

One particular field which may be useful in the various metadata formatswould be a field which includes an identifier of a plug-in or othersoftware element which may be used to capture metadata from a data fileand/or export metadata back to the creator application.

Various different software architectures may be used to implement thefunctions and operations described herein. The following discussionprovides one example of such an architecture, but it will be understoodthat alternative architectures may also be employed to achieve the sameor similar results. The software architecture shown in FIG. 4 is anexample which is based upon the Macintosh operating system. Thearchitecture 400 includes a metadata processing software 401 and anoperating system (OS) kernel 403 which is operatively coupled to themetadata processing software 401 for a notification mechanism which isdescribed below. The metadata processing software 401 is also coupled toother software programs such as a file system graphical user interfacesoftware 405 (which may be the Finder), an email software 407, and otherapplications 409. These applications are coupled to the metadataprocessing software 401 through client application program interface 411which provide a method for transferring data and commands between themetadata processing software 401 and the software 405, 407, and 409.These commands and data may include search parameters specified by auser as well as commands to perform searches from the user, whichparameters and commands are passed to the metadata processing software401 through the interface 411. The metadata processing software 401 isalso coupled to a collection of importers 413 which extract data fromvarious applications. In particular, in one exemplary embodiment, a textimporter is used to extract text and other information from wordprocessing or text processing files created by word processing programssuch as Microsoft Word, etc. This extracted information is the metadatafor a particular file. Other types of importers extract metadata fromother types of files, such as image files or music files. In thisparticular embodiment, a particular importer is selected based upon thetype of file which has been created and modified by an applicationprogram. For example, if the data file was created by PhotoShop, then animage importer for PhotoShop may be used to input the metadata from aPhotoShop data file into the metadata database 415 through the metadataprocessing software 401. On the other hand, if the data file is a wordprocessing document, then an importer designed to extract metadata froma word processing document is called upon to extract the metadata fromthe word processing data file and place it into the metadata database415 through the metadata processing software 401. Typically, a pluralityof different importers may be required in order to handle the pluralityof different application programs which are used in a typical computersystem. The importers 413 may optionally include a plurality ofexporters which are capable of exporting the extracted metadata forparticular types of data files back to property sheets or other datacomponents maintained by certain application programs. For example,certain application programs may maintain some metadata for each datafile created by the program, but this metadata is only a subset of themetadata extracted by an importer from this type of data file. In thisinstance, the exporter may export back additional metadata or may simplyinsert metadata into blank fields of metadata maintained by theapplication program.

The software architecture 400 also includes a file system directory 417for the metadata. This file system directory keeps track of therelationship between the data files and their metadata and keeps trackof the location of the metadata object (e.g. a metadata file whichcorresponds to the data file from which it was extracted) created byeach importer. In one exemplary embodiment, the metadata database ismaintained as a flat file format as described below, and the file systemdirectory 417 maintains this flat file format. One advantage of a flatfile format is that the data is laid out on a storage device as a stringof data without references between fields from one metadata file(corresponding to a particular data file) to another metadata file(corresponding to another data file). This arrangement of data willoften result in faster retrieval of information from the metadatadatabase 415.

The software architecture 400 of FIG. 4 also includes find by contentsoftware 419 which is operatively coupled to a database 421 whichincludes an index of files. The index of files represents at least asubset of the data files in a storage device and may include all of thedata files in a particular storage device (or several storage devices),such as the main hard drive of a computer system. The index of files maybe a conventional indexed representation of the content of eachdocument. The find by content software 419 searches for words in thatcontent by searching through the database 421 to see if a particularword exists in any of the data files which have been indexed. The findby content software functionality is available through the metadataprocessing software 401 which provides the advantage to the user thatthe user can search concurrently both the index of files in the database421 (for the content within a file) as well as the metadata for thevarious data files being searched. The software architecture shown inFIG. 4 may be used to perform the method shown in FIG. 5 or alternativearchitectures may be used to perform the method of FIG. 5.

The method of FIG. 5 may begin in operation 501 in which a notificationof a change for a file is received. This notification may come from theOS kernel 403 which notifies the metadata processing software 401 that afile has been changed. This notification may come from sniffer softwareelements which detect new or modified files and deletion of files. Thischange may be the creation of a new file or the modification of anexisting file or the deletion of an existing file. The deletion of anexisting file causes a special case of the processing method of FIG. 5and is not shown in FIG. 5. In the case of a deletion, the metadataprocessing software 401, through the use of the file system directory417, deletes the metadata file in the metadata database 415 whichcorresponds to the deleted file. The other types of operations, such asthe creation of a new file or the modification of an existing file,causes the processing to proceed from operation 501 to operation 503 inwhich the type of file which is the subject of the notification isdetermined. The file may be an Acrobat PDF file or an RTF wordprocessing file or a JPEG image file, etc. In any case, the type of thefile is determined in operation 503. This may be performed by receivingfrom the OS kernel 403 the type of file along with the notification orthe metadata processing software 401 may request an identification ofthe type of file from the file system graphical user interface software405 or similar software which maintains information about the data file,such as the creator application or parent application of the data file.It will be understood that in one exemplary embodiment, the file systemgraphical user interface software 405 is the Finder program whichoperates on the Macintosh operating system. In alternative embodiments,the file system graphical user interface system may be Windows Explorerwhich operates on Microsoft's Windows operating system. After the typeof file has been determined in operation 503, the appropriate capturesoftware (e.g. one of the importers 413) is activated for the determinedfile type. The importers may be a plug-in for the particular applicationwhich created the type of file about which notification is received inoperation 501. Once activated, the importer or capture software importsthe appropriate metadata (for the particular file type) into themetadata database, such as metadata database 415 as shown in operation507. Then in operation 509, the metadata is stored in the database. Inone exemplary embodiment, it may be stored in a flat file format. Thenin operation 511, the metadata processing software 401 receives searchparameter inputs and performs a search of the metadata database (andoptionally also causes a search of non-metadata sources such as theindex of files 421) and causes the results of the search to be displayedin a user interface. This may be performed by exchanging informationbetween one of the applications, such as the software 405 or thesoftware 407 or the other applications 409 and the metadata processingsoftware 401 through the interface 411. For example, the file systemsoftware 405 may present a graphical user interface, allowing a user toinput search parameters and allowing the user to cause a search to beperformed. This information is conveyed through the interface 411 to themetadata processing software 401 which causes a search through themetadata database 415 and also may cause a search through the database421 of the indexed files in order to search for content within each datafile which has been indexed. The results from these searches areprovided by the metadata processing software 401 to the requestingapplication which, in the example given here, was the software 405, butit will be appreciated that other components of software, such as theemail software 407, may be used to receive the search inputs and toprovide a display of the search results. Various examples of the userinterface for inputting search requests and for displaying searchresults are described herein and shown in the accompanying drawings.

It will be appreciated that the notification, if done through the OSkernel, is a global, system wide notification process such that changesto any file will cause a notification to be sent to the metadataprocessing software. It will also be appreciated that in alternativeembodiments, each application program may itself generate the necessarymetadata and provide the metadata directly to a metadata databasewithout the requirement of a notification from an operating systemkernel or from the intervention of importers, such as the importers 413.Alternatively, rather than using OS kernel notifications, an embodimentmay use software calls from each application to a metadata processingsoftware which receives these calls and then imports the metadata fromeach file in response to the call.

As noted above, the metadata database 415 may be stored in a flat fileformat in order to improve the speed of retrieval of information in mostcircumstances. The flat file format may be considered to be a non-Btree, non-hash tree format in which data is not attempted to beorganized but is rather stored as a stream of data. Each metadata objector metadata file will itself contain fields, such as the fields shown inthe examples of FIGS. 3A and 3B. However, there will typically be norelationship or reference or pointer from one field in one metadata fileto the corresponding field (or another field) in the next metadata fileor in another metadata file of the same file type. FIG. 6 shows anexample of the layout in a flat file format of metadata. The format 601includes a plurality of metadata files for a corresponding plurality ofdata files. As shown in FIG. 6, metadata file 603 is metadata from file1 of application A and may be referred to as metadata file A1.Similarly, metadata file 605 is metadata from file 1 of application Band may be referred to as metadata file B1. Each of these metadata filestypically would include fields which are not linked to other fields andwhich do not contain references or pointers to other fields in othermetadata files. It can be seen from FIG. 6 that the metadata database ofFIG. 6 includes metadata files from a plurality of differentapplications (applications A, B, and C) and different files created byeach of those applications. Metadata files 607, 609, 611, and 617 areadditional metadata files created by applications A, B, and C as shownin FIG. 6.

A flexible query language may be used to search the metadata database inthe same way that such query languages are used to search otherdatabases. The data within each metadata file may be packed or evencompressed if desirable. As noted above, each metadata file, in certainembodiments, will include a persistent identifier which uniquelyidentifies its corresponding data file. This identifier remains the sameeven if the name of the file is changed or the file is modified. Thisallows for the persistent association between the particular data fileand its metadata.

User Interface Aspects

Various different examples of user interfaces for inputting searchparameters and for displaying search results are provided herein. Itwill be understood that some features from certain embodiments may bemixed with other embodiments such that hybrid embodiments may resultfrom these combinations. It will be appreciated that certain featuresmay be removed from each of these embodiments and still provide adequatefunctionality in many instances.

FIG. 7A shows a graphical user interface which is a window which may bedisplayed on a display device which is coupled to a data processingsystem such as a computer system. The window 701 includes a side barhaving two regions 703A, which is a user-configurable region, and 703B,which is a region which is specified by the data processing system.Further details in connection with these side bar regions may be foundin co-pending U.S. patent application Ser. No. 10/873,661 filed Jun. 21,2004, and entitled “Methods and Apparatuses for Operating a DataProcessing System,” by inventors Donald Lindsay and Bas Ording. Thewindow 701 also includes a display region 705 which in this casedisplays the results of searches requested by the user. The window 701also includes a search parameter menu bar 707 which includesconfigurable pull down menus 713, 715, and 717. The window 701 alsoincludes a text entry region 709 which allows a user to enter text aspart of the search query or search parameters. The button 711 may be astart search button which a user activates in order to start a searchbased upon the selected search parameters. Alternatively, the system mayperform a search as soon as it receives any search parameter inputs orsearch queries from the user rather than waiting for a command to beginthe search. The window 701 also includes a title bar 729 which may beused in conjunction with a cursor control device to move, in aconventional manner, the window around a desktop which is displayed on adisplay device. The window 701 also includes a close button 734, aminimize button 735, and a resize button 736 which may be used to closeor minimize or resize, respectively, the window. The window 701 alsoincludes a resizing control 731 which allows a user to modify the sizeof the window on a display device. The window 701 further includes aback button 732 and a forward button 733 which function in a mannerwhich is similar to the back and forward buttons on a web browser, suchas Internet Explorer or Safari. The window 701 also includes viewcontrols which include three buttons for selecting three different typesof views of the content within the display region 705. When the contentsfound in a search exceed the available display area of a display region705, scroll controls, such as scroll controls 721, 722, and 723, appearwithin the window 701. These may be used in a conventional manner, forexample, by dragging the scroll bar 721 within the scroll region 721Ausing conventional graphical user interface techniques.

The combination of text entry region 709 and the search parameter menubar allow a user to specify a search query or search parameters. Each ofthe configurable pull down menus presents a user with a list of optionsto select from when the user activates the pull down menu. As shown inFIG. 7A, the user has already made a selection from the configurablepull down menu 713 to specify the location of the search, which in thiscase specifies that the search will occur on the local disks of thecomputer systems. Configurable pull down menu 715 has also been used bythe user to specify the kind of document which is to be searched for,which in this case is an image document as indicated by the configurablepull down menu 715 which indicates “images” as the selectedconfiguration of this menu and hence the search parameter which itspecifies. The configurable pull down menu 717, as shown in FIG. 7A,represents an add search parameter pull down menu. This add searchparameter pull down menu allows the user to add additional criteria tothe search query to further limit the search results. In the embodimentshown in FIG. 7A, each of the search parameters is logically ANDed in aBoolean manner. Thus the current search parameter specified by the userin the state shown in FIG. 7A searches all local disks for all images,and the user is in the middle of the process of selecting another searchcriteria by having selected the add search criteria pull down menu 717,resulting in the display of the pull down menu 719, which has aplurality of options which may be selected by the user.

FIG. 7B shows the window 701 after the user has caused the selection ofthe time option within pull down menu 719, thereby causing the displayof a submenu 719A which includes a list of possible times which the usermay select from. Thus it appears that the user wants to limit the searchto all images on all local disks within a certain period of time whichis to be specified by making a selection within the submenu 719A.

FIG. 7C shows the window 701 on the display of a data processing systemafter the user has selected a particular option (in this case “pastweek”) from the submenu 719A. If the user accepts this selection, thenthe display shown in FIG. 7D results in which the configurable pull downmenu 718 is displayed showing that the user has selected as part of thesearch criteria files that have been created or modified in the pastweek. It can be seen from FIG. 7D that the user can change theparticular time selected from this pull down menu 718 by selectinganother time period within the pull down menu 718A shown in FIG. 7D.Note that the configurable pull down menu 717, which represents an addsearch parameter menu, has now moved to the right of the configurablepull down menu 718. The user may add further search parameters bypressing or otherwise activating the configurable pull down menu 717from the search parameter menu bar 707. If the user decides that thepast week is the proper search criteria in the time category, then theuser may release the pull down menu 718A from being displayed in avariety of different ways (e.g. the user may release the mouse buttonwhich was being depressed to keep the pull down menu 718A on thedisplay). Upon releasing or otherwise dismissing the pull down menu718A, the resulting window 701 shown in FIG. 7E then appears. There areseveral aspects of this user interface shown in FIG. 7A-7E which areworthy of being noted. The search parameters or search query isspecified within the same window as the display of the search results.This allows the user to look at a single location or window tounderstand the search parameters and how they affected the displayedsearch results, and may make it easier for a user to alter or improvethe search parameters in order to find one or more files. Theconfigurable pull down menus, such as the add search parameter pull downmenu, includes hierarchical pull down menus. An example of this is shownin FIG. 7B in which the selection of the time criteria from the pulldown menu 717 results in the display of another menu, in this case asubmenu 719A which may be selected from by the user. This allows for acompact presentation of the various search parameters while keeping theinitial complexity (e.g. without submenus being displayed) at a lowerlevel. Another useful aspect of the user interface shown in FIG. 7A-7Eis the ability to reconfigure pull down menus which have previously beenconfigured. Thus, for example, the configurable pull down menu 713currently specifies the location of the search (in this case, all localdisks), however, this may be modified by selecting the pull down regionassociated with the configurable pull down menu 713, causing the displayof a menu of options indicating alternative locations which may beselected by the user. This can also be seen in FIG. 7D in which the pastweek option has been selected by the user (as indicated by “past week”being in the search parameter menu bar 707), but a menu of options shownin the pull down menu 718A allows the user to change the selected timefrom the “past week” to some other time criteria. Another useful aspectof this user interface is the ability to continue adding various searchcriteria by using the add search criteria pull down menu 717 andselecting a new criteria.

It will also be appreciated that the various options in the pull downmenus may depend upon the fields within a particular type of metadatafile. For example, the selection of “images” to be searched may causethe various fields present in the metadata for an image type file toappear in one or more pull down menus, allowing the user to searchwithin one or more of those fields for that particular type of file.Other fields which do not apply to “images” types of files may notappear in these menus in order reduce the complexity of the menus and toprevent user confusion.

Another feature of the present invention is shown in FIGS. 7A-7E. Inparticular, the side bar region 703A, which is the user-configurableportion of the side bar, includes a representation of a folder 725 whichrepresents the search results obtained from a particular search, whichsearch results may be static or they may be dynamic in that, in certaininstances, the search can be performed again to obtain results based onthe current files in the system. The folder 725 in the example shown inFIGS. 7A-7E represents a search on a local disk for all images done onDecember 10^(th). By selecting this folder in the side bar region 703A,the user may cause the display in the display region 705 of the resultsof that search. In this way, a user may retrieve a search resultautomatically by saving the search result into the side bar region 703A.One mechanism for causing a search result or a search query to be savedinto the side bar region 703A is to select the add folder button 727which appears in the bottom portion of the window 701. By selecting thisbutton, the current search result or search query is saved as a list offiles and other objects retrieved in the current search result. In thecase where the search query is saved for later use rather than thesaving of a search result, then the current search query is saved forre-use at a later time in order to find files which match the searchquery at that later time. The user may select between these twofunctionalities (saving a search result or saving a search query) by theselection of a command which is not shown.

FIGS. 8A and 8B show another aspect of a user interface feature whichmay be used with certain embodiments of the present invention. Thewindow 801 of FIG. 8A represents a display of the search results whichmay be obtained as a result of using one of the various differentembodiments of the present invention. The search results are separatedinto categories which are separated by headers 805, 807, 809, and 811which in this case represent periods of time. This particularsegmentation with headers was selected by the user's selecting theheading “date modified” using the date modified button 803 at the top ofthe window 801. An alternative selection of the kind category byselecting the button 802 at the top of the window 801A shown in FIG. 8Bresults in a different formatting of the search results which are nowcategorized by headers which indicate the types of files which wereretrieved in the search and are separated by the headings 815, 817, 819,and 821 as shown in FIG. 8B. The use of these headings in the searchresults display allows the user to quickly scan through the searchresults in order to find the file.

FIG. 9 shows another aspect of the present invention that is illustratedas part of the window 901 shown in FIG. 9. This window includes adisplay region 905 which shows the results of the search and the windowalso includes two side bar regions 903A and 903B, where the side barregion 903A is the user-configurable portion and the side bar region903B is the system controlled portion. A folder add button 927 may beselected by the user to cause the addition of a search result or asearch query to be added to the user-configurable portion of the sidebar. The window 901 also includes conventional window controls such as atitle bar or region 929 which may be used to move the window around adisplay and view select buttons 937 and maximize, minimize and resizebuttons 934, 935, and 936 respectively. The window 901 shows aparticular manner in which the results of a text-based search may bedisplayed. A text entry region 909 is used to enter text for searching.This text may be used to search through the metadata files or theindexed files or a combination of both. The display region 905 shows theresults of a search for text and includes at least two columns, 917 and919, which provide the name of the file that was found and the basis forthe match. As shown in column 919, the basis for the match may be theauthor field or a file name or a key word or comments or other datafields contained in metadata that was searched. The column 921 shows thetext that was found which matches the search parameter typed into thetext entry field 909. Another column 911 provides additional informationwith respect to the search results. In particular, this column includesthe number of matches for each particular type of category or field aswell as the total number of matches indicated in the entry 913. Thus,for example, the total number of matches found for the comments field isonly 1, while other fields have a higher number of matches.

FIG. 10 shows certain other aspects of some embodiments of the presentinvention. Window 1001 is another search result window which includesvarious fields and menus for a user to select various search parametersor form a search query. The window 1001 includes a display region 1005which may be used to display the results of a search and auser-configurable side bar portion 1003A and a system specified side barportion 1003B. In addition, the window 1001 includes conventionalscrolling controls such as controls 1021 and 1022 and 1021A. The windowfurther includes conventional controls such as a title bar 1029 whichmay be used to move the window and view control buttons 1037 andmaximize, minimize, and resize buttons 1034, 1035, and 1036. A startsearch button 1015 is near a text entry region 1009. A first searchparameter menu bar 1007 is displayed adjacent to a second searchparameter bar 1011. The first search parameter search bar 1007 allows auser to specify the location for a particular search while two menu pulldown controls in the second search parameter menu bar 1011 allow theuser to specify the type of file using the pull down menu 1012 and thetime the file was created or last modified using the menu 1013.

The window 1001 includes an additional feature which may be very usefulwhile analyzing a search result. A user may select individual files fromwithin the display region 1005 and associate them together as onecollection. Each file may be individually marked using a specificcommand (e.g. pressing the right button on a mouse and selecting acommand from a menu which appears on the screen, which command may be“add selection to current group”) or similar such commands. Byindividually selecting such files or by selecting a group of files atonce, the user may associate this group of files into a selected groupor a “marked” group and this association may be used to perform a commonaction on all of the files in the group (e.g. print each file or vieweach file in a viewer window or move each file to a new or existingfolder, etc.). A representation of this marked group appears as a folderin the user-configurable portion 1003A. An example of such a folder isthe folder 1020 shown in the user-configurable portion 1003A. Byselecting this folder (e.g. by positioning a cursor over the folder 1020and pressing and releasing a mouse button or by pressing another button)the user, as a result of this selection, will cause the display withinthe display region 1005 of the files which have been grouped together ormarked. Alternatively, a separate window may appear showing only theitems which have been marked or grouped. This association or groupingmay be merely temporary or it may be made permanent by retaining a listof all the files which have been grouped and by keeping a folder 1020 orother representations of the grouping within the user-configurable sidebar, such as the side bar 1003A. Certain embodiments may allow multiple,different groupings to exist at the same time, and each of thesegroupings or associations may be merely temporary (e.g. they exist onlywhile the search results window is displayed), or they may be madepermanent by retaining a list of all the files which have been groupedwithin each separate group. It will be appreciated that the files withineach group may have been created from different applications. As notedabove, one of the groupings may be selected and then a user may select acommand which performs a common action (e.g. print or view or move ordelete) on all of the files within the selected group.

FIGS. 11A, 11B, 11C, and 11D show an alternative user interface forallowing a user to input search queries or search parameters. The userinterface shown in these figures appears within the window 1101 whichincludes a user-configurable side bar region 1103A and a systemspecified side bar region 1103B. The window 1101 also includestraditional window controls such as a window resizing control 1131 whichmay be dragged in a conventional graphical user interface manner toresize the window, and the window further includes scrolling controlssuch as controls 1121, 1122, and 1123. The scrolling control 1121 may,for example, be dragged within the scrolling region 1121A or a scrollwheel on a mouse or other input device may be used to cause scrollingwithin a display region 1105. Further, traditional window controlsinclude the title bar 1129 which may be used to move the window around adesktop which is displayed on a display device of a computer system andthe window also includes view buttons 1137 as well as close, minimize,and resize buttons 1134, 1135 and 1136. A back and forward button, suchas the back button 1132, are also provided to allow the user to moveback and forth in a manner which is similar to the back and forthcommands in a web browser. The window 1101 includes a search parametermenu bar 1111 which includes a “search by” pull down menu 1112 and a“sort by” pull down menu 1114. The “search by” pull down menu 1112allows a user to specify the particular search parameter by selectingfrom the options which appear in the pull down menu once it is activatedas shown in FIG. 11B. In particular, the pull down menu 1113 shows oneexample of a pull down menu when the “search by” pull down menu 1112 hasbeen activated. The “sort by” pull down menu 1114 allows a user tospecify how the search results are displayed within a display region1105. In the example shown in FIGS. 11A-11D a user has used the “sortby” pull down menu 1114 to select the “date viewed” criteria to sort thesearch results by. It should also be noted that the user may change thetype of view of the search results by selecting one of the three viewbuttons 1137. For example, a user may select an icon view which is thecurrently selected button among the view buttons 1137, or the user mayselect a list view or a column view.

FIG. 11B shows the result of the user's activation of a “search by” pulldown menu 1112 which causes the display of the menu 1113 which includesa plurality of options from which the user may choose to perform asearch by. It will be appreciated that there are a number of differentways for a user to activate the “search by” pull down menu 1112. One wayincludes the use of a cursor, such as a pointer on a display which iscontrolled by a cursor control device, such as a mouse. The cursor ispositioned over the region associated with the “search by” menu title(which is the portion within the search parameter menu bar 1111 whichcontains the words “search by”) and then the user indicates theselection of the menu title by pressing a button, such as a mouse'sbutton, to cause the pull down menu to appear, which in this case is themenu 1113 shown in FIG. 11B. At this point, the user may continue tomove the cursor to point to a particular option within the menu, such asthe “time” option. This may result in the display of a submenu to theleft or to the right of the menu 1113. This submenu may be similar tothe submenu 719A or to the menu 1214 shown in FIG. 12A. If the “kind”option is selected in the menu 1113, the submenu may include a genericlist of the different kinds of documents, such as images, photos,movies, text, music, PDF documents, email documents, etc. or the listmay include references to specific program names such as PhotoShop,Director, Excel, Word, etc. or it may include a combination of genericnames and specific names. FIG. 11C shows the result of the user havingselected PhotoShop type of documents from a submenu of the “kind” optionshown in menu 1113. This results in the display of the search parametermenu bar 1111A shown in FIG. 11C which includes a highlighted selection1111B which indicates that the PhotoShop type of documents will besearched for. The search parameter menu bar 1111 appears below thesearch parameter menu bar 1111A as shown in FIG. 11C. The user may thenspecify additional search parameters by again using the “search by” pulldown menu 1112 or by typing text into the text entry field 1109. Forexample, from the state of the window 1101 shown in FIG. 11C, the usermay select the “search by” pull down menu 1112 causing the display of amenu containing a plurality of options, such as the options shown withinthe menu 1113 or alternative options such as those which relate toPhotoShop documents (e.g. the various fields in the metadata forPhotoShop type of documents). A combination of such fields containedwithin metadata for PhotoShop type documents and other generic fields(e.g. time, file size, and other parameters) may appear in a menu, suchas the menu 1113 which is activated by selecting the “search by” pulldown menu. The user may then select another criteria such as the timecriteria. In this case, the window 1101 displays a new search parametermenu bar 1115 which allows a user to specify a particular time. The usermay select one of the times on the menu bar 1115 or may activate a pulldown menu by selecting the menu title “time,” which is shown as the menutitle 1116. The state of the window 1101 shown in FIG. 11D would thensearch for all PhotoShop documents created in the last 30 days or 7 daysor 2 days or today or at any time, depending on the particular timeperiod selected by the user.

FIGS. 12A, 12B, 12C and 12D show another example of a user interface forallowing the creation of search queries for searching metadata and otherdata and for displaying the results of the search performed using asearch query. The different implementation shown in FIGS. 12A-12D showsa user interface presentation in a column mode; this can be seen bynoting the selection of the column button, which is the rightmost buttonin the view buttons 1237 shown in FIG. 12A. The window 1201 has twocolumns 1211 and the display region 1205, while the window 1251 of FIG.12C has three columns which are columns 1257, 1259, and the displayregion 1255, and the window 1271 has three columns which are columns1277, 1279, and the display region 1275.

The window 1201 shown in FIGS. 12A and 12B includes a display region1205 which shows the results of a search; these results may be showndynamically as the user enters search parameters or the results may beshown only after the user has instructed the system to perform thesearch (e.g. by selecting a “perform search” command). The window 1201includes conventional window controls, such as a resizing control 1231,a scrolling control 1221, a title bar 1229 which may be used to move thewindow, a window close button, a window minimize button, and a windowresize button 1234, 1235, and 1236, respectively. The window 1201 alsoincludes a user-configurable side bar region 1203A and a systemspecified side bar region 1203B. It can be seen from FIG. 12A that abrowse mode has been selected as indicated by the highlighted “browse”icon 1203C in the system specified side bar region 1203B. The window1201 also includes a text entry region 1209, which a user may use toenter text for a search, and the window 1201 also includes view selectorbuttons 1237.

A column 1211 of window 1201 allows a user to select various searchparameters by selecting one of the options which in turn causes thedisplay of a submenu that corresponds to the selected option. In thecase of FIG. 12A, the user has selected the “kind” option 1212 and thenhas used the submenu 1214 to select the “photos” option from thesubmenu, resulting in an indicator 1213 (photos) to appear in the column1211 under the “kind” option as shown in FIG. 12A. It can also be seenthat the user has previously selected the “time” option in the column1211 and has selected from a submenu brought up when the “time” optionwas selected the “past week” search parameter. When the user hasfinished making selections of the various options and suboptions fromboth the column 1112 and any of the corresponding submenus which appear,then the display showed in FIG. 12B appears. Note that the submenus areno longer present and that the user has completed the selection of thevarious options and suboptions which specify the search parameters.Column 1211 in FIG. 12B provides feedback to the user indicating theexact nature of the search query (in this case a search for all photosdated in the past week), and the results which match the search queryare shown in the display region 1205.

FIGS. 12C and 12D show an alternative embodiment in which the submenuswhich appear on a temporary basis in the embodiment of FIGS. 12A and 12Bare replaced by an additional column which does not disappear after aselection is made. In particular, the column 1259 of the window 1251functions in the same manner as the submenu 1214 except that it remainswithin the window 1251 after a selection is made (wherein the submenu1214 is removed from the window after the user makes the selection fromthe submenu). The column 1279 of window 1271 of FIG. 12D is similar tothe column 1259. The window 1251 includes a side bar which has auser-configurable side bar region 1253A and a system defined side barregion 1253B. The system specified side bar region 1253B includes a“browse” selection region 1254 which has a clear button 1258 which theuser may select to clear the current search query. The window 1271 ofFIG. 12D provides an alternative interface for clearing the searchquery. The window 1271 also includes a user configurable side bar region1273A and a system specified side bar region 1273B, but the clearbutton, rather than being with the “search” region 1274 is at the top ofthe column 1277. The user may clear the current search parameter byselecting the button 1283 as shown in FIG. 12D.

FIG. 13A shows another embodiment of a window 1301 which displays searchresults within a display region 1302. The window 1301 may be acloseable, minimizeable, resizeable, and moveable window having aresizing control 1310, a title bar 1305 which may be used to move thewindow, a text entry region 1306 and a user configurable portion 1303,and a system specified portion 1304. The window 1301 further includesbuttons for selecting various views, including an icon view, a listview, and a column view. Currently, the list view button 1316 has beenselected, causing the display of the search results in a list viewmanner within the display region 1302. It can be seen that the text(“button”) has been entered into the text entry region 1306 and this hascaused the system to respond with the search results shown in thedisplay region 1302. The user has specified a search in every locationby selecting “everywhere” button 1317. Further, the user has searchedfor any kind of document by selecting the “kind” option from the pulldown menu 1315 and by selecting the “any” option in the pull down menu1319. The where or location slice 1307 includes a “+” button which maybe used to add further search parameters, and similarly, the slice 1308includes a “+” and a “−” button for adding or deleting searchparameters, respectively. The slice 1307 further includes a “save”button 1309 which causes the current search query to be saved in theform of a folder which is added to the user configurable portion 1303for use later. This is described further below and may be referred to asa “smart folder.” The search input user interface shown in FIGS. 13A and13B is available within, in certain embodiments, each and every windowcontrolled by a graphical user interface file management system, such asa Finder program which runs on the Macintosh or Windows Explorer whichruns on Microsoft Windows. This interface includes the text entry region1306 as well as the slices 1307 and 1308.

The window 1301 shown in FIG. 13B shows the activation of a menu byselecting the search button 1323A, causing a display of a menu havingtwo entries 1323 and 1325. Entry 1323 displays recently performedsearches so that a user may merely recall a prior search by selectingthe prior search and cause the prior search to be run again. The menuselection 1325 allows the user to clear the list of recent searches inthe menu.

FIGS. 14A, 14B, and 14C show examples of another window in a graphicaluser interface file system, such as the Finder which runs on theMacintosh operating system. These windows show the results of aparticular search and also the ability to save and use a smart folderwhich saves a prior search. The window 1401 shown in FIG. 14A includes adisplay region 1403, a user configurable region 1405, a smart folder1406, a system specified region 1407, an icon view button 1409, a listview button 1410, and a column view button 1411. The window 1401 alsoincludes a text entry region 1415 and a location slice 1416 which may beused to specify the location for the search, which slice also includes asave button 1417. Additional slices below the slice 1416 allow the userto specify further details with respect to the search, in this casespecifying types of documents which are images which were last viewedthis week. The user has set the search parameters in this manner byselecting the “kind” option from the pull down menu 1419 and byselecting the “images” type from the pull down menu 1420 and byselecting the “last viewed” option from pull down menu 1418 and byselecting “this week” from the pull down menu 1422. The user has alsoselected “everywhere” by selecting the button 1421 so that the searchwill be performed on all disks and storage devices connected to thissystem. The results are shown within the display region 1403. The usercan then save the search query by selecting the “save” button 1417 andmay name the saved search query as “this week's images” to produce thesmart folder 1406 as shown in the user configurable portion 1405. Thisallows the user to repeat this search at a later time by merelyselecting the smart folder 1406 which causes the system to perform a newsearch again, and all data which matches the search criteria will bedisplayed within the display region 1403. Thus, after several weeks, arepeating of this search by selecting the smart folder 1406 will producean entirely different list if none of the files displayed in the displayregion 1403 of FIG. 14A are viewed in the last week from the time inwhich the next search is performed by selecting the smart folder 1406.

FIG. 14B shows a way in which a user may sort or further search withinthe search results specified by a saved search, such as a smart folder.In the case of FIG. 14B, the user has selected the smart folder 1406 andhas then entered text “jpg” 1425 in the text entry region 1415. This hascaused the system to filter or further limit the search results obtainedfrom the search query saved as the smart folder 1406. Thus. PhotoShopfiles and other files such as TIF files and GIF files are excluded fromthe search results displayed within the display region 1403 of FIG. 14Bbecause the user has excluded those files by adding an additional searchcriteria specified by the text 1425 in the text entry region 1415. Itcan be seen that the “jpg” text entry is ANDed logically with the othersearch parameters to achieve the search results displayed in the displayregion 1403. It can also be seen that the user has selected the iconview by selecting the icon view button 1409. Thus, it is possible for auser to save a search query and use it later and to further limit theresults of the search query by performing a search on the results of thesearch query to further limit the search results.

FIG. 14C shows the window 1401 and shows the search results displayedwithin the display region 1403, where the results are based upon thesaved search specified by the smart folder 1406. The user has caused apull down menu 1427 to appear by selecting the pull down region 1427A.The pull down region 1427 includes several options which a user mayselect. These options include hiding the search criteria or saving thesearch (which is similar to selecting the button 1417) or showing viewoptions or opening the selected file. This allows the user, for example,to hide the search criteria, thereby causing the slice 1416 and theother search parameters to be removed from the window 1401 which is amoveable, resizeable, minimizeable, and closeable window.

FIG. 14D shows an example of a user interface which allows the user tospecify the appearance of a smart folder, such as the smart folder 1406.

FIGS. 15A, 15B, 15C, and 15D show an example of a system wide searchinput user interface and search result user interface. In one particularexemplary embodiment, these user interfaces are available on the entiresystem for all applications which run on the system and all files andmetadata, and even address book entries within an address book program,such as a personal information manager, and calendar entries within acalendar program, and emails within an email program, etc. In oneexemplary embodiment, the system begins performing the search and beginsdisplaying the results of the search as the user types text into a textentry field, such as the text entry field 1507. The search results areorganized by categories and are displayed as a short list which isintentionally abbreviated in order to present only a selected number ofthe most relevant (scored) matches or hits to the search query. The usercan ask for the display of all the hits by selecting a command, such asthe “show all” command 1509. FIG. 15A shows a portion of a displaycontrolled by a data processing system. This portion includes a menu bar1502 which has at its far end a search menu command 1505. The user canselect the search menu command by positioning a cursor, using a mouse,for example, over the search menu command 1505 and by pressing a buttonor by otherwise activating or selecting a command. This causes a displayof a text entry region 1507 into which a user can enter text. In theexample shown in FIG. 15A, which is a portion of the display, the userhas entered the text “shakeit” causing the display of a search resultregion immediately below a “show all” command region 1509 which isitself immediately below the text entry region 1507. It can be seen thatthe hits or matches are grouped into categories (“documents” and “PDFdocuments”) shown by categories 1511 and 1513 within the search resultregion 1503. FIG. 15B shows another example of a search. In this case, alarge number of hits was obtained (392 hits), only a few of which areshown in the search result region 1503. Again, the hits are organized bycategories 1511 and 1513. Each category may be restricted in terms ofthe number of items displayed within the search result region 1503 inorder to permit the display of multiple categories at the same timewithin the search result region. For example, the number of hits in thedocuments category may greatly exceed the available display space withinthe search result region 1503, but the hits for this category arelimited to a predetermined or dynamically determinable number of entrieswithin the search result region 1503 for the category 1511. Anadditional category, “top hit” is selected based on a scoring orrelevancy using techniques which are known in the art. The user mayselect the “show all” command 1509 causing the display of a window, suchas window 1601 shown in FIG. 16A. FIG. 15C shows a display of agraphical user interface of one embodiment of the invention whichincludes the menu bar 1502 and the search menu command 1505 on the menubar 1502. FIG. 15D shows another example of the search result region1503 which appeared after a search of the term “safari” was entered intothe text entry region 1507. It can be seen from the search result region1503 of FIG. 15D that the search results are again grouped intocategories. Another search result window 1520 is also shown in the userinterface of FIG. 15D. It can be seen that application programs areretrieved as part of the search results, and a user may launch any oneof these application programs by selecting it from the search resultregion, thereby causing the program to be launched.

FIGS. 16A and 16B show examples of search result windows which may becaused to appear by selecting the “show all” command 1509 in FIG. 15A or15B. Alternatively, these windows may appear as a result of the userhaving selected a “find” command or a some other command indicating thata search is desired. Moreover, the window 1601 shown in FIGS. 16A and16B may appear in response to either of the selection of a show allcommand or the selection of a find command. The window 1601 includes atext entry region 1603, a group by menu selection region 1605, a sort bymenu selection region 1607, and a where menu selection region 1609. Thegroup by selection region 1605 allows a user to specify the manner inwhich the items in the search results are grouped according to. In theexample shown in FIG. 16A, the user has selected the “kind” option fromthe group by menu selection region 1605, causing the search results tobe grouped or sorted according to the kind or type of document or file.It can be seen that the type of file includes “html” files, image files,PDF files, source code files, and other types of files as shown in FIG.16A. Each type or kind of document is separated from the other documentsby being grouped within a section and separated by headers from theother sections. Thus, headers 1611, 1613, 1615, 1617, 1619, 1621, and1623 designate each of the groups and separate one group from the othergroups. This allows a user to focus on evaluating the search resultsaccording to certain types of documents. Within each group, such as thedocument groups or the folder groups, the user has specified that theitems are to be sorted by date, because the user has selected the dateoption within the sort by menu region 1607. The user has also specifiedthat all storage locations are to be searched by selecting “everywhere”from the where menu selection region 1609. Each item in the searchresult list includes an information button 1627 which may be selected toproduce the display of additional information which may be availablefrom the system. An example of such additional information is shown inFIG. 17 in which a user has selected the information button 1627 foritem 1635, resulting in the display of an image 1636 corresponding tothe item as well as additional information 1637. Similarly, the user hasselected the information button for another item 1630 to produce thedisplay of an image of the item 1631 as well as additional information1632. The user may remove this additional information from the displayby selecting the close button 1628 which causes the display of theinformation for item 1635 to revert to the appearance for that itemshown in FIG. 16A. The user may collapse an entire group to hide theentries or search results from that group by selecting the collapsebutton 1614 shown in FIG. 16A, thereby causing the disappearance of theentries in this group as shown in FIG. 16B. The user may cause theseitems to reappear by selecting the expand button 1614A as shown in FIG.16B to thereby revert to the display of the items as shown in FIG. 16A.

The search results user interface shown in FIGS. 16A and 16B presentsonly a limited number of matches or hits within each category. In theparticular example of these figures, only the five top (most relevant ormost highly sorted) hits are displayed. This can be seen by noticing theentry at the bottom of each list within a group which specifies how manymore hits are within that group; these hits can be examined by selectingthis indicator, such as indicator 1612, which causes the display of allof the items in the documents category or kind for the search for“button” which was entered into the text entry region 1603. Furtherexamples of this behavior are described below and are shown inconjunction with FIGS. 18A and 18B. It will be appreciated that window1601 is a closeable and resizable and moveable window and includes aclose button and a resizing control 1625A.

FIGS. 18A and 18B illustrate another window 1801 which is very similarto the window 1601. The window 1801 includes a text entry region 1803, agroup by menu selection region 1805, a sort by menu selection region1807, and a where menu selection region 1809, each of which function ina manner which is similar to the regions 1605, 1607, and 1609respectively of FIG. 16A. Each item in a list view within the window1801 includes an information button 1827, allowing a user to obtainadditional information beyond that listed for each item shown in thewindow 1801. The window 1801 further includes headers 1811, 1813, 1815,1817, 1819, 1821, and 1823 which separate each group of items, groupedby the type or kind of document, and sorted within each group by date,from the other groups. A collapse button 1814 is available for each ofthe headers. The embodiment shown in FIGS. 18A and 18B shows the abilityto switch between several modes of viewing the information. For example,the user may display all of the hits within a particular group byselecting the indicator 1812 shown in FIG. 18A which results in thedisplay of all of the images files within the window 1801 within theregion 1818A. The window is scrollable, thereby allowing the user toscroll through all the images. The user can revert back to the listingof only five of the most relevant images by selecting the “show top 5”button 1832 shown in FIG. 18B. Further, the user can select between alist view or an icon view for the images portion shown in FIGS. 18A and18B. The user may select the list view by selecting the list view button1830 or may select the icon view by selecting the icon view button 1831.The list view for the images group is shown in FIG. 16A and the iconview for the images group is shown in FIGS. 18A and 18B. It can be seenthat within a single, moveable, resizable, closeable search resultwindow, that there are two different views (e.g. a list view and an iconview) which are concurrently shown within the window. For example, thePDF documents under the header 1819 are displayed in a list view whilethe images under the header 1817 are displayed in an icon view in FIGS.18A and 18B. It can also be seen from FIGS. 18A and 18B that each imageis shown with a preview which may be capable of live resizing asdescribed in a patent application entitled “Live Content Resizing” byinventors Steve Jobs, Steve Lemay, Jessica Kahn, Sarah Wilkin, DavidHyatt, Jens Alfke, Wayne Loofbourrow, and Bertrand Serlet, filed on Jun.25, 2004, and being assigned to the assignee of the present inventionsdescribed herein, and which is hereby incorporated herein by reference.

FIG. 19A shows another example of a search result window which issimilar to the window 1601. The window 1901 shown in FIG. 19A includes atext entry region 1903 and a group by menu selection region 1905 and asort by menu selection region 1907 and a where menu selection region1908. Further, the window includes a close button 1925 and a resizingcontrol 1925A. Text has been entered into the text entry region 1903 toproduce the search results shown in the window 1901. The search resultsagain are grouped by a category selected by a user which in this case isthe people options 1906. This causes the headers 1911, 1913, 1915, and1917 to show the separation of the groups according to names of people.Within each group, the user has selected to sort by the date of theparticular file or document. The user interface shown in FIG. 19A allowsa user to specify an individual's name and to group by people to lookfor communications between two people, for example. FIG. 19B showsanother way in which a user can group a text search (“imran”) in amanner which is different from that shown in FIG. 19A. In the case ofFIG. 19B, the user has selected a flat list from the group by menuselection region 1905 and has selected “people” from the sort by menuregion 1907. The resulting display in window 1901A is without headersand thus it appears as a flat list.

FIG. 19C shows the user interface of another search result window 1930which includes a text entry region 1903 and the selection regions 1905,1907, and 1908 along with a scrolling control 1926. The results shown inthe window 1930 have been grouped by date and sorted within each groupby date. Thus, the headers 1932, 1934, 1936, 1938, and 1940 specify timeperiods such as when the document was last modified (e.g. last modifiedtoday, or yesterday, or last week). Also shown within the search resultswindow 1930 is the information button 1942 which may be selected toreveal further information, such as an icon 1945 and additionalinformation 1946 as shown for one entry under the today group. Thisadditional information may be removed by selecting the contractionbutton 1944.

FIG. 19D shows a search result window 1950 in which a search for thetext string “te” is grouped by date but the search was limited to a“home” folder as specified in the where menu selection region 1908. Timespecific headers 1952, 1954, 1956, and 1958 separate items within onegroup from the other groups as shown in FIG. 19D.

FIG. 19E shows an alternative embodiment of a search result window. Inthis embodiment, the window 1970 includes elements which are similar towindow 1901 such as the selection regions 1905, 1907, and a scrollingcontrol 1926 as well as a close button 1925 and a resizing control1925A. The search result window 1970 further includes a “when” menuselection region 1972 which allows the user to specify a searchparameter based on time in addition to the text entered into the textentry region 1903. It can be seen from the example shown in FIG. 19Ethat the user has decided to group the search results by the categoryand to sort within each group by date. This results in the headers 1973,1975, 1977, and 1979 as shown in FIG. 19E.

FIG. 20 shows an exemplary method of operating a system wide menu forinputting search queries, such as the system wide menu available byselecting the search menu command 1505 shown in FIG. 15A or 15B, or 15C.In operation 2001, the system displays a system wide menu for inputtingsearch queries. This may be the search menu command 1505. The user, inoperation 2003, inputs a search, and as the search query is beinginputted, the system begins performing and begins displaying the searchresults before the user finishes inputting the search query. This givesimmediate feedback and input to the user as the user enters thisinformation. The system is, in operation 2005, performing a searchthrough files, metadata for the files, emails within an email program,address book entries within an address book program, calendar entrieswithin a calendar program, etc. The system then, in operation 2007,displays an abbreviated (e.g. incomplete) list of hits if there are morethan a certain number of hits. An example of this abbreviated listing isshown in FIG. 15B. The listing may be sorted by relevance and segregatedinto groups such as categories or types of documents. Then in operation2009, the system receives a command from the user to display all thehits and in operation 2011 the system displays the search resultswindow, such as the window 1601 shown in FIG. 16A. This window may havethe ability to display two different types of views, such as an iconview and a list view within the same closeable, resizable, and moveablewindow. It will be appreciated that the searching, which is performed asthe user is typing and the displaying of results as the user is typingmay include the searching through the metadata files created frommetadata extracted from files created by many different types ofsoftware programs.

Another aspect of the present inventions relates to previews, displayedwithin search results windows, which are at least one of beingresizeable, zoomable, or pageable through. For example, a firstrepresentation of a first file found by the search may be at least oneof being resizeable or zoomable or scrollable or pageable through withina display region, such as a window, which contains the results of thesearch. FIG. 21 shows an exemplary method for performing at least someof the functionality of this aspect. In operation 2901, a user's searchinput is received by a data processing system which, in turn, inoperation 2903, performs the search and then presents the search resultsbased on the user's search input. In addition, the results are presentedsuch that, for at least one file which was found by the search, the fileis represented by a preview or other representation of the file, wherethe preview or other representation is either resizeable or zoomable orscrollable or pageable through or a combination of those capabilities.For example, if the file which is found is a picture file, then athumbnail of the picture file may be the representation which isresizeable within the search results window, such that it can beenlarged in size or decreased in size on the display device within thesearch results window. Further, the picture, which is a thumbnail whichrepresents the file, may be zoomable in that the content of therepresentation may be zoomed in (e.g. magnified) or out (e.g.demagnified) while maintaining the same area or size of therepresentation. In addition or alternatively, the content in therepresentation may be pageable in that multiple different pages of thecontent may be displayed either sequentially over time by paging throughthe multiple pages in sequence, as if one were flipping through pages ina book, or multiple pages may be spread out concurrently. One or more ofthese actions may be possible, depending upon the particular type ofcontent. Images will typically be resizeable or zoomable or scrollableand may also be pageable, for example. In at least certain embodimentsof the present invention, as shown in operation 2907, the representationwithin the search results window may be resized or scrolled or zoomed orpaged through without having to launch the application which created thecontent.

A preview, at least in certain embodiments, can apply to files or otherobjects (e.g. records, emails, messages, vCards, etc.). A single pagepreview can be used for a thumbnail or in any situation where a singleimage is needed to provide a preview of an item. Multiple items can bepreviewed at once and compared, or viewed in sequence. When multipleitems are previewed at once, they can be of any file type including manydifferent file types. The previews can be shown in the same window asthe search results window or in a separate window or in a layer that isoverlaid above the item, shown in a search result, which is beingpreviewed in the layer above.

A preview may be presented using a variety of different implementations,such as a plug-in implementation which uses one or more plug-ins, suchas a QuickTime plug-in, etc. Each of the previews may be formatted inone of several standard data/file types (such as PDF, text, HTML, JPEG,a movie format, or a sound/music format). The previews may be eithergenerated by the application, which created the item or file representedby the preview, when the item or file is stored or may be generateddynamically when needed. A dynamically generated preview may be producedby invoking a generator plug-in that translates the native format of theitem being previewed to one of the “standard” data/file types (e.g. PDF,text, HTML, JPEG, a standard movie format, or a standard sound/musicformat). A preview generator plug-in may be loaded in a separate processto protect against failures and/or security vulnerabilities.Alternatively, a trusted generator plug-in (e.g. QuickTime), or a set ofsuch plug-ins may be loaded directly in the process of presenting thesearch results and such plug-ins may be used to present the previews. Apreview generator may be capable of handling multiple preview requestsconcurrently and the preview generator and/or the search softwarecontrolling the search results window may manage a queue of previewrequests, and the search software can cancel or reorder the previewrequests in the queue.

The following figures show examples of previews or other representationswhich are resizeable or zoomable or scrollable or pageable through. FIG.22A shows an example of a preview 3001 displayed on a display device,either within a search result window or as an overlay on the window. Thepreview 3001 is scrollable and resizeable; it may be scrolled using anyone of the scroll controls 3002, 3003 and/or 3004. It may be resizedusing the resize control 3005. FIG. 22B shows a preview 3010 which candisplay multiple documents or items in a scrollable format. The viewshown in FIG. 22B of the preview 3010 shows only one document andanother document can be selected for viewing using interface controls3015, 3013, and 3017. The view of preview 3010 is scrollable usingscroll controls 3011, 3012A and/or 3012B. The view of preview 3010 isalso resizeable using resize control 3005. The user can also switch todisplay multiple documents or items at once in the view of preview 3010by selecting the user interface control 3019 which will cause thepreview shown in FIG. 22B to appear similar to the preview shown in FIG.22C which shows multiple documents concurrently. The preview shown inFIG. 22C may also be scrollable.

Previews or other representations which are resizeable or scrollable orzoomable or pageable through may also be provided in other userinterfaces which may include alternative types of views such as a coverflow view which is further described below. FIG. 23 provides an exampleof one method of using a cover flow view, such as the cover flow viewarea 2318 shown in FIG. 24A. In operation 2301, a data processing systemdisplays one or more windows containing a user interface of a filesystem, such as a hierarchical file system (HFS) or a user interface ofa search software, such as the search software known as Spotlight fromApple Inc. of Cupertino, Calif. The window 2316 is an example of awindow containing a user interface of a file system; in this case, thefile system user interface is the program Finder from Apple Inc. Anotherexample of a user interface for a file system is the user interfaceprovided by the Windows Explorer computer program from Microsoft. Anexample of a window which contains a user interface of a searchsoftware, such as the search software Spotlight, is the window 2401shown in FIG. 25A. These windows may be moveable, resizeable, closeable,and be able to overlap with other windows. For example, other windowsmay partially cover the window displayed in operation 2301 or the windowdisplayed in operation 2301 may cover other windows. Moreover, thewindow may be moveable around the display device (e.g. by positioning acursor over a portion of the window, such as the title bar of thewindow, and by then moving the cursor after the title bar has beenselected by a user to thereby move the window) and the window may beresizeable, by using one or more user interface objects as is known inthe art, or closeable or minimizeable. In operation 2303, the dataprocessing system may display user selectable view options fordisplaying files and folders. These view options may include an iconview, or a list view, or a column view, or a cover flow view. One ormore of these view options may be selected by a user through a userinterface object, such as the icon view user interface object 2330 orthe list view user interface object 2331, or the column view userinterface object 2332, or the cover flow view user interface object 2333shown in FIG. 24A. These selectable view options may be displayed withinthe window displayed in operation 2301 or in another part of the userinterface such as in a menu bar or other selectable menu object or adock, such as dock 2317. In operation 2305, the data processing systemmay display scrolling user interface objects which may include arrowuser interface objects, such as the up-scroll user interface object 2348and the down-scroll user interface object 2349 shown in FIG. 24A. Thesescrolling user interface objects may allow scrolling of one or moreviews either concurrently or separately as further described below. Eachview may include its own set of scrolling user interface objects or asingle set of scrolling user interface objects may be used to scrollboth views if the scrolling is concurrent or linked as further describedbelow. In operation 2307, the data processing system may receive one ormore user commands from the cover flow view area or from other viewareas to perform file system operations, such as creating a new folderin the HFS, and the system responds by performing these operations.Commands may be received through various user interface objects,including pull-down menus on a menu bar, such as the menu bar 2312 shownin FIG. 24A, or a contextual command user interface object, such as thecontextual command user interface object 2335, or through a dragging anddropping manipulation on an icon representing the document or file fromone window to another window or within the same window, etc. These userinterface objects may be in the same window as the window displayed inoperation 2301 or in different or other portions of the user interfacedisplayed on the display device of the data processing system. Inaddition to or instead of user commands to perform file systemoperations, the data processing system may receive user commandsrequesting a zoom or a scroll or a page through or a resizing of contentdisplayed within the cover flow area as further described below. Thedata processing system may also, in operation 2309, display userselectable options to sort a list or flow view either concurrently orseparately. These user selectable options may include options to sort bythe name of a file or the type/kind of file or the date last used orother parameters which may be used to sort files in either a list viewor other types of views, such as an icon view or column view or a coverflow view as described further below.

It will be understood that the method shown in FIG. 23 is one generalexample of a use of a cover flow view to display content within a filesystem and to receive commands for the file system through the coverflow view, such as through direct manipulation of icons representingdocuments in the cover flow view. Further, the method of FIG. 23 mayalso be used in the context of receiving search inputs and providing thesearch results through software which provides a user interface forsearching for files in a file system, such as an HFS. It will beappreciated that the operations shown in FIG. 23, as in other flowcharts described herein, may be performed in a different order and mayinclude fewer operations than shown in FIG. 23 or may include moreoperations than shown in FIG. 23.

FIG. 24A shows an example of the user interface on a display device 2311which is coupled to a data processing system or which is part of a dataprocessing system. The particular user interface shown in FIG. 24Arepresents the user interface of a file system provided by softwarewhich runs on an operating system and which may be referred to as a filemanagement software; the Finder from Apple Inc. of Cupertino, Calif.,and Windows Explorer from Microsoft Corporation of Redmond, Wash., aretwo examples of file management software which allow a user to managefiles in an HFS maintained by a data processing system. The files can bedisplayed in one or more windows and users can perform operations on thefiles by selecting menu options or by performing direct manipulation, asin a drag and drop operation or by the use of contextual menu items orby the use of right-clicking on a file and selecting commands from acontextual menu (e.g. a contextual pop-up menu) or in other mannersknown in the art. The user interface as shown in FIG. 24A may include amenu bar 2312 which is displayed at the top of the display device in atleast certain embodiments and which includes a pull-down menu such asthe pull-down menu 2315 which includes the word “File” at the top of thepull-down menu, which is known in the art. The user interface may alsoinclude a dock 2317 or a task bar on some region of the screen, such asthe lower bottom portion region of the screen, or in other locations.The task bar or dock may be used to house a minimized window as is knownin the art, which results from the selection by the user of the minimizewindow user interface object 2324 shown in the upper left corner of thewindow 2316. The activation of this minimize window user interfaceobject 2324 causes the window to be minimized, as is known in the art,which results in an icon of the window appearing on the dock 2317 or, inother implementations, a task bar. The window can be put in its priorstate by selecting that icon in the dock or the task bar. The window2316 also includes a side bar region which is described above and whichis also described in co-pending U.S. patent application Ser. No.10/873,661, filed Jun. 21, 2004. This side bar region isuser-configurable and allows a user to add folders created by the userinto the side bar region for easy access to those folders or directorieswithout requiring the user to drill down through a hierarchy of foldersto reach a desired folder. In the case of the side bar region 2320 shownin FIG. 24A, the user has selected the folder “My Documents” which is aparticular selected subdirectory in a HFS. The title bar of the window2316 also shows the “My Documents” name, indicating that the filesdisplayed within the window 2316 are within the folder “My Documents.”The window 2316 also includes two regions which display the files withinthis folder. The cover flow view area 2318 shows a cover flow view ofthe files within the “My Documents” folder. The list display view area2319 also shows those files but in a traditional list view. As can beseen from FIG. 24A, the list view and the cover flow view area areadjacent and contained within the same moveable, resizeable, andminimizeable window.

The window 2316 also includes a search input field 2314A into which auser may enter one or more search terms to cause the data processingsystem to perform a search, such as the searches described above,through metadata and/or one or more indexes of the full content offiles, such as text files. The user interface may also include a searchinput menu area 2314B which may be activated by the user (e.g. byclicking in the area on an icon in the area) to cause the display ofanother search input field into which a user can enter one or moresearch terms to cause a search to also be performed as described above.The window may also include one or more icons which a user can select toselect one or more views within the window 2316. Examples of such iconsare the icons 2330, 2331, 2332, and 2333 shown in the upper portion ofthe window 2316. In particular, the icon view interface object 2330 maybe selected by a user to cause the display of files within a particularfolder or group of folders in an icon view manner as is known in theart. The selection of the list view user interface object 2331 willcause the display of files in a list, such as in a manner which issimilar to the list display view area 2319; this list will typicallyinclude one or more columns, such as name, kind, and last used date asshown in FIG. 24A which can be used to sort the list in a variety ofdifferent ways as is described further below, in conjunction with, forexample, FIG. 24B. The column view user interface object 2332 may beselected by the user to cause a column view as is known in the art.Lastly, the cover flow view user interface object 2333 may be selectedto cause a cover flow view which may be a view of the cover flow viewarea by itself or a view with the cover flow view area and the listdisplay view area, such as the list display view area 2319 as shown inFIG. 24A. The window 2316 may also include a close window user interfaceobject 2322 and a maximize window user interface object 2325 whichoperate to close and maximize the window respectively as is known in theart. The window 2316 may also include a back control user interfaceobject 2327 and a forward control user interface object 2328 whichoperate to toggle the contents of the window back or forward through ahistory list of the window's previous displays as is known in the art.The window 2316 may also include a contextual command user interfaceobject 2335 which, when activated or selected, presents a menu ofoptions such as the menu shown as menu 2365 or other menus from which auser can choose one or more commands depending on the context of thesystem. These commands may be commands to perform file system operationssuch as moving or copying files, or creating a folder or otheroperations, including search operations. The window 2316 may alsoinclude one or more scroll control user interface objects for the sidebar region 2320, such as the scroll control user interface objects 2361which may be used to scroll up and down the side bar region 2320. Thewindow 2316 may also include a resize control user interface object 2326which may be selected by a user and then dragged by the user to resizethe window 2316 as is known in the art.

The window 2316 may have two sets of scroll control user interfaceobjects. One set may control scrolling within the cover flow view areaand the other set may control scrolling within the list display viewarea. The scrolling of one view area may be linked to the scrolling ofthe other view area, such that activation of a scroll control in one ofthe sets to cause scrolling in one view area will also cause acorresponding scrolling in the other view area. In alternativeembodiments, the scrolling may not be linked, such that one area can bescrolled independently of the other area; for example, scrolling thelist display view area does not cause scrolling in the cover flow viewarea in this alternative embodiment. The scroll controls for the coverflow view area include the scroll bar control object 2346 which may bedragged or moved by a user, and it further includes the left scroll userinterface object 2344 which acts like a left scroll arrow, and the rightscroll user interface object 2345 which acts as a right scroll arrow.Together these three objects are part of the scroll control userinterface object 2343. The scroll controls for the list display viewarea include a scroll bar control object 2347 and an up-scroll userinterface object 2348 and a down-scroll user interface object 2349 tocause scrolling in a known manner. The cover flow view area includes aset of documents on one side of the selected document 2337 in the coverflow view area and another set of documents or files on the other sideof the selected document 2337. In particular, document 2339 and anotherdocument are on the left side of the selected document 2337 and thedocuments 2341 and 2353 are on the right side of the selected document2337. As can be seen from FIG. 24A, the density of documents on eitherside of the selected document is higher than the density of documentsbetween the rightmost edge of document 2339 and the leftmost edge ofdocument 2341. In other words, the selected document in the cover flowview is spaced apart from the collection of documents on either side ofit. Furthermore, in the cover flow view, the documents on either side ofthe selected document are shown in perspective view such that thedocuments on the left side appear to face the selected document whilethe documents on the right side appear to face the selected document.Also, when several documents are on one side of the selected document,at least some of the documents are covered by other documents on thatside; in other words, on that side, the documents are arranged in anoverlapping manner. Further, when a document moves from one side of theselected document to the other side of the selected document, itscontent will appear to change the direction in which it faces. This canbe seen by comparing document 2339 in FIG. 24A with document 2339 inFIG. 24B. In the case of FIG. 24A, the document 2339 appears to facetowards the right side, which is towards the selected document 2337,while in FIG. 24B, the document 2339 appears to face towards the left,which is also towards the selected document 2337 in FIG. 24B. As thedocument moves across the selected document position in the middle ofthe cover flow area, the direction of its content appears to switch.This may again be due to the perspective view in which the documentappears to be angled. This may also be due to the use of differentlengths of sides for two parallel sides of a thumbnail or icon in thecover flow view. For example, document 2339 appears to have two parallelsides which are vertical but which do not have an equal length even ifthe document represented by document 2339, in fact, has two such sideswhich are of equal length. This can also be seen by comparing the twovertical sides of the thumbnail 2376 in FIG. 24F.

It will be appreciated that the files and items displayed in the coverflow view and in the list view 2318 and 2319, respectively, may includea variety of different documents of a variety of different types, suchas text files, PDF files, picture files such as JPG files, web page(e.g. HTML) files, Microsoft Word or Excel files, movie files, otherfiles and other file types noted herein, and folders or subdirectoriesas is commonly found in file management software such as the Finder orWindows Explorer. These folders may be containers for other documents ina hierarchical file system as is known in the art.

In addition to the use of a cover flow view for a view of files andfolders in either or both of a file management software program (such asthe Finder) or a search software program (such as Spotlight), a coverflow view may also be provided in “open” or “save as” windows which arepresented/displayed to a user to allow the user to open an existing filefrom within an application (such as a word processing or imageprocessing or web browsing application) or to save a file from withinsuch application.

FIG. 24B illustrates an example of how the sort controls in the listview, such as sort control 2319A, may be used to change the order inwhich the files and/or folders are displayed within both the list viewarea 2319 and the cover flow view area 2318. In particular, the user orthe system has changed the order of the last used date by toggling thesort control user interface object 2319A between two different states.In the case of FIG. 24A, the dates are sorted from oldest to mostrecent, and in the case of FIG. 24B, the files and/or folders are sortedfrom most recent to oldest. It will be appreciated that the user maysimilarly toggle or otherwise change one or more of the other sortcontrol user interface objects (e.g. name; kind; etc.) in order toachieve different sortings of the files and/or folders. The change insorting between FIGS. 24A and 24B is reflected in both the list displayview area 2319 and the cover flow view area 2318. It can be seen thatthe order of the files in both view areas in FIG. 24A is the same and ischanged to that shown in FIG. 24B in which the order of the files inboth view areas is also the same but different than the order shown inFIG. 24A.

The user interface shown in FIG. 24C shows how the user or the systemcan change the selected document 2342 within the list display view area2319 and thereby cause the change in the selected document shown in thecover flow view area. In the case of FIG. 24A, the user or the systemhas selected as the selected document the document entitled “SalesHelp,” thereby causing this document to also appear as the selecteddocument 2337 in the cover flow view area 2318. In the case of the userinterface shown in FIG. 24C, the user or the system has selected thedocument “MaxServ” as the selected document 2342 which has, in turn,caused the selected document to appear as document 2341 in the coverflow view area 2318. In some embodiments, the selected document may beselected by selecting a document (e.g. document 2341) in the cover flowview to change the selected document in both views.

FIGS. 24D and 24E will now be referred to while describing the variousfile system operations which a user may cause to be performed throughthe use of a file management software program such as the Finder orWindows Explorer. In the case of the user interface shown in FIG. 24D,the user or the system has opened a second window 2355 which overlapspartially the window 2316. The window 2355, like the window 2316, alsoincludes various user interface objects, including user interfaceobjects 2322-2325, 2327-2328, 2330-2333, and 2326. The window 2355 alsoincludes a side bar region in which the user or the system has selectedthe folder “Instructions” 2357 which is different than the selectedfolder in the side bar region of the window 2316. Hence, the window 2355displays the contents of the folder or subdirectory “Instructions” whichincludes five files shown in the icon view area 2359, which displays thefiles as icons because the user or the system has selected the icon viewuser interface object 2330 to cause the display of the files as icons,as is known in the art. The window 2355 also includes a search inputfield 2314A into which a user or the system may enter a search input tocause the system to perform a search as described herein with respect tometadata and/or one or more indexes of full-text content in one or moreindex databases. The user may use the user interface shown in FIGS. 24Dand 24E to perform a variety of different file management tasks usingthe file management software in either window or both windows. Forexample, the user may select one or more files or folders from eitherthe cover flow area view or the list view area in window 2316 and dragthe selected file(s) or folder(s) into the window 2355 to relocate thefile or folder within the “Instructions” folder or another folder. Bydragging a file or folder from either the cover flow view area withinwindow 2316 or the list view area 2319, the user can move that file fromthe “My Documents” folder to the “Instructions” folder (which is adifferent subdirectory in the HFS) by depositing the file or folderwithin the icon view area 2359 within the window 2355. Alternatively, auser may drag a file from the window 2355 into the cover flow view area2318 in the window 2316 or to the list view area 2319 within the window2316 and thereby relocate the file from the “Instructions” folder intothe “My Documents” folder. Numerous other file management activities maybe performed from either the cover flow area or the list view or theicon view within window 2355. For example, the user may select adocument or folder within the cover flow view area and then select acommand such as “copy” or “duplicate” which causes the file or documentto be duplicated and then move that file, with either a drag and dropoperation or a cut and paste operation or other operations, to anotherfolder such as the “Instructions” folder. In certain embodiments, theuser may use the contextual command user interface object 2335 toperform operations on a file or to perform other operations to managethe files using the file management software, such as the Finder. Byselecting or activating the contextual command user interface object2335, a menu, such as the menu 2365, may be displayed, and the user maythen select an option from that menu by positioning the cursor 2363 overthat option and pressing and releasing a button or otherwise indicatingthe selection of that menu option. As shown in FIG. 24E, the user mayselect the option “New Folder” to create a new folder within the “MyDocuments” folder or may duplicate an existing file by selecting thefile and then selecting “duplicate” or selecting “duplicate” and thenselecting the file, in certain embodiments. Further, the user may makean alias or shortcut of a file selected to be selected. Further, theuser may delete a file that has been selected or to be selected or maycause a file to be moved by selecting the “Move To” folder option.Numerous other file management operations may be performed eitherthrough direct manipulation methods (drag and drop operations) orright-clicking operations, in which a user selects a file by pressingthe mouse's right button which causes the display of a contextual menufrom which the user can select a file system operation, or by selectingthe file pull-down menu 2315 which includes a variety of differentpossible commands, or by selecting other pull-down menus on the menu bar2312 or by performing other operations known in the art. These variousactions allow a user to utilize the cover flow view area as if it was anicon view or a list view to perform file management operations. Theseoperations may include, for example, moving a file within the HFS;creating a copy of a file in the HFS; deleting a file in the HFS;creating a new folder in the HFS; moving a folder in the HFS; creating acopy of a folder in the HFS; deleting a folder in the HFS; moving a filefrom a first folder to a second folder in the HFS; moving a file orfolder to or from the desktop; changing access permissions of a file orfolder and/or changing the name of a file in the HFS.

FIGS. 24F and 24G provide two further examples of a user interface forviewing files, browsing files, or manipulating files using a filemanagement software, such as the Finder, from within the cover flow viewarea. In this case, the cover flow view area includes thumbnails ofmovies contained within the Movies folder 2373 shown in the side barregion 2330. It will be appreciated that the window 2371 has differentfolders in the side bar and different documents in the Movies folderthan the window 2316; this may be because the system has been changedover time, for example. The Movies folder includes movies shown in thelist display view area 2319, which are shown also, in the same order, inthe cover flow view area 2318. The thumbnails shown in the cover flowview area include thumbnails 2375, which in this case is the selecteddocument, as well as thumbnails 2376, 2377, and 2378, in addition toseveral other thumbnails shown on the right side of the selecteddocument 2375. A cursor 2379 is shown near the center of the thumbnail2375. As described herein, the user may perform a variety of differentfile management operations by selecting thumbnails within the cover flowview or icons within the list view to perform those operations. Forexample, in one embodiment, the user may select a thumbnail within thecover flow view area 2318 and drag that thumbnail to one of the foldersin the side view area 2320 to relocate the particular thumbnail. Forexample, the user may select the thumbnail 2375 or another thumbnailwithin the cover flow view area 2318 and drag that particular selectedthumbnail to the Utilities folder or to some other folder or locationavailable within the side bar region 2320. Alternatively, the user maydrag the thumbnail to the desktop region 2313. In addition to using adirect manipulation technique such as drag and drop, the user may selectthe object and then select a command either from a pull-down menu or thecontextual command user interface object or may right-click on theselected document or other document within the cover flow area andselect a command from a contextual or pop-up menu to perform a filemanagement software operation. FIG. 24G shows the window 2471 after theuser or the system has selected a different selected document in thecover flow area, which in this case is the thumbnail 2377. Thisselection may occur by using the cursor 2379 and positioning the cursorat the thumbnail 2377 within the cover flow view area 2318 shown in FIG.24G and pressing a button or otherwise selecting the thumbnail 2377.Alternatively, this may occur by selecting the file corresponding to thethumbnail 2377 from within the list display area 2319. Alternatively,this may also occur by using one or both of the scroll control userinterface objects, such as the scroll bar control object 2346 or thescroll bar control object 2347, etc. in order to cause scrolling withinthe cover flow view area and/or the list display view area.

FIGS. 25A and 25B provide examples of user interfaces in which the coverflow view area is used in the context of a search software program, suchas Spotlight from Apple Inc. of Cupertino, Calif. The cover flow viewarea may be used to display the results of a search, in addition to anoptional list view, and the user may be able to directly manipulate theicons or thumbnails retrieved by the search from the cover flow viewarea in order to obtain further information about the document or fileretrieved by the search. For example, this further manipulation mayinclude causing a zoom of the document to occur or to present multiplepages by paging through or scrolling through a document shown in thecover flow view. In the case of FIGS. 25A and 25B, a user may haveentered a search phrase (e.g. “movie”) into the search input field 2314Aand caused the data processing system to perform a search as describedherein. For example, a search through metadata and/or an index databasemay retrieve various movies and cause the results of that search to bedisplayed in both the list display view area 2319 and the cover flowview area 2318. As shown in the cover flow view area 2318, seven filesor movies have been retrieved, including those represented by thethumbnails 2405, 2407, 2409, and 2411. The cursor 2403 is available foruse by the user to select one or more of the thumbnails for furtherinspection. For example, in the case of FIG. 25B, the user has selectedthe thumbnail 2407 to present that thumbnail as the selected document inthe middle of the cover flow area 2318. This may be performed by eitherselecting the thumbnail 2407 directly in the cover flow area 2318 or byselecting that movie document within the list display view area 2319.

An example of the use of the manipulation of a document or file fromwithin the cover flow view area will now be provided relative to themethod shown in FIG. 26A in conjunction with FIGS. 26B, 26C, 26D, 26E,26F, 26G, 26H, and 26I. The method shown in FIG. 26A may begin inoperation 2501 in which a window is displayed by the data processingsystem. The window may have a user interface of a cover flow view andoptionally may also display a list view within the same window. Anexample of this operation is shown in FIG. 26B in which the window 2511includes a cover flow view area 2318 and a list display view area 2319in the same window 2511. In operation 2503, the data processing systemreceives a user's command to zoom or page through or scroll through adocument shown in or selected from the cover flow view area. Thiscommand may be through the user's selection of a user interface objector a direct manipulation or a variety of other techniques describedherein. For example, the user may desire to page through a multiple pagedocument by selecting arrow icons such as the arrow icons 2521 or 2523.In other embodiments, the user command may be the selection of a scrollcontrol, such as one or more of the scroll controls 2531 or 2532 or 2533shown in FIG. 26F in order to cause scrolling through the document. Inother embodiments, the user interface object may, when selected, causezooming of the object from one size to another size, such as the zoomingshown in FIGS. 27A-27N or the zoomed view shown in FIG. 26D or 26F. Thesystem, in operation 2505, responds to the user's command to zoom orpage through or scroll through the document in or selected from thecover flow view area. Examples of the response of such a system areshown in FIGS. 26C, and 26E, and 26I, for example.

FIG. 26B shows the window 2511 which displays the search results of asearch based on the word “instructions” 2512 entered into the searchinput field 2314A or entered, alternatively, in a field presented inresponse to activating a search input menu area 2314B. The searchresults produced a number of documents shown in both the list displayview area 2319 and the cover flow view area 2318. The list of documentsincludes the selected document 2514 which is shown as the thumbnail2515A within the cover flow view area 2318. Other thumbnails or previewsshown in the cover flow view area 2318 include thumbnails 2517, 2516,2518, and 2519. The thumbnail or preview 2515A includes a left arrow2521 and a right arrow 2523. These arrows may be used to page through,one page at a time or several pages at a time, a thumbnailrepresentation of the file or document represented by the thumbnail2515A. FIG. 26C shows the result of the activation of the right arrowicon 2523, causing the data processing system to present the second ornext page of the document or file, which is shown as the thumbnail 2515Bin FIG. 26C. FIGS. 26D, 26E, 26F, 26G, 26H, and 26I also showalternative ways of presenting multiple pages through a preview orthumbnail which is activated from a cover flow view, such as the coverflow view area 2318. In the case of FIG. 26D, the thumbnail or previewis an enlarged view which may be zoomed with a continuous orintermittent animation from the thumbnail 2515A to present the preview2515C as shown in FIG. 26D. The preview or thumbnail 2515C may also bepaged through by activating either of the arrow icons 2521 or 2523. FIG.26E shows the second or next page of the document as the preview orthumbnail 2515D which in effect is an enlarged or zoomed view of thethumbnail 2515B shown in FIG. 25C. FIGS. 26F and 26G show an alternativein which a scrolling user interface is provided to allow the user toscroll through multiple pages of a multiple page document. Inparticular, a scroll control user interface may include a scroll bar2531, an up arrow 2532, and a down arrow 2533 which allows the user tosee multiple pages in the preview mode, such as the preview 2515E shownin FIG. 26F, or the next page shown as preview 2515F in FIG. 26G. Theembodiment shown in FIGS. 26H and 26I shows the use of a scrolling userinterface to display a preview of a file or document within the coverflow view area 2318 without requiring a large, zoomed preview as in thecase of the embodiments shown in FIGS. 26F and 26G. In this case, thelist display view area 2319 remains visible and useable while the coverflow view area 2318 displays multiple pages of a selected document, suchas the selected document shown as interactive preview 2516A. The usermay scroll through the content of the preview 2516A by using one or moreof the scroll control user interface objects which include the scrollbar control user interface object 2546 or the up arrow 2547 or the downarrow 2545. The view shown in FIG. 26H shows the top or beginning partof the document represented by the preview 2516A, and the view shown inFIG. 26I shows the preview 2516B which shows the bottom portion of thedocument represented by the preview 2516B.

As described above, these previews or thumbnails may be shown by a setof software routines such as a set of plug-ins which are separate from afile management software program, such as the Finder or WindowsExplorer. This separation between the plug-ins which renders the contentand the Finder or other file management software provides security andstability because, for example, if the plug-in crashes, the Finder willnot. These plug-ins may be a standard set of plug-ins that translate thenative format of an item being previewed into one of a standarddata/file type, such as PDF, text, HTML, JPG, a standard movie format ora standard sound/music format or into fully rendered content (e.g. a bitmap). The set of plug-ins may be an extensible set of plug-ins and mayinteract with the file management software, such as the Finder orWindows Explorer, through a set of APIs in which the file managementsoftware makes a call to a plug-in management daemon which receives thecall or API from the file management software (or other softwareprogram) and which, in turn, asks for the file type (e.g. UTI) from afile system kernel and matches one of the plug-ins in the standard setof plug-ins, which may be extensible, with the file type and which thencalls the matched plug-in to cause the plug-in to load and return thecontent of the file (either in an immediately displayable form or in astandard format) as a preview to the file management software which, inturn, causes the preview to be displayed in, for example, the cover flowview area. This may occur in response to merely browsing the filesthrough the use of the file management software, such as the Finder, orthrough the use of a search software program, such as Spotlight, to findfiles and then display previews or thumbnails of files retrieved by thesearch. As noted above, the preview or thumbnail may be generateddynamically upon request rather than when the item or file is stored orcreated by the application. This dynamic generation may be through anAPI. It will be understood that a dynamic generation of a preview orthumbnail may be provided without invoking or launching the applicationwhich created the file or document. Examples of software architecturesto dynamically generate previews are discussed in conjunction with FIG.31. In addition to a file management software program or a searchsoftware program, such as Spotlight, other software application programsmay provide or use application programming interfaces (API) to requestthe preview generator or preview daemon to provide a preview orthumbnail of the content of a document within their windows. Forexample, an email program or a calendar program or a video conferencingapplication or an instant messaging application program or otherapplication programs may also make a call to the preview generator orpreview generator daemon to provide the content of a particular file inthe manner described herein. In response to the call through an API fromthe email program or the calendar program or other program, the previewgenerator or preview generator daemon asks the file system for the filetype and matches the file type with a plug-in having an ability toprocess that file type and causes that plug-in to be loaded (forexample, by calling the plug-in through another optional API). Theplug-in, in turn, processes the content of the file to generate thepreview or thumbnail and provides that content to the originalapplication which requested the content, such as the email program or acalendar program or, as noted above, a file management software. Apreview or thumbnail may be provided in an inline preview manner in thecover flow view area or in an icon view or in an inline preview mannerwithin a list view, such as the list view shown in FIG. 17 (whichincludes a preview or thumbnail view) or in a “get information” or“properties” panel or window or in other uses.

FIGS. 24B, 26B, and 26H will be referred to in order to provide anexample of how an interactive preview may be presented through this setof software routines while also showing an initial set of previews. Forexample, thumbnails of files may be the initial set of previews shown ina particular view (e.g. list view or cover flow view), and the set ofsoftware routines provide an interactive preview, within the same view,for at least one of these initial previews. The initial previews mayalso be provided by this set of software routines, but these initialpreviews may not be interactive with the view; for example, they are notinteractive within the view, in response to user commands so they willnot, in response to user commands, allow a user to page through orscroll through or browse through the content or to zoom or resize thecontent or playback the content, such as playback the movie. On theother hand, the interactive preview is interactive in response to usercommands in that it can respond to a user command to page through orscroll through or browse or resize or zoom the document represented bythe interactive preview or playback the content, either within theparticular view (e.g. a list view or cover flow view (see, e.g. FIGS.26B, 26H and 26I) or icon view) or zoom out from the particular view(see, e.g. FIGS. 27A through 27N) or be layered over the particular view(see, e.g., FIG. 26D). In FIG. 24B, the document with the heading “HDDVR5444A” may be considered an initial preview in the cover flow viewshown in FIG. 24B. That same document is shown as an interactive preview(with paging buttons) in FIG. 26B. That same document is shown again inan initial preview form in FIG. 26H while another document (which isshown as thumbnail 2516 in FIG. 26B) is shown in FIG. 26H as aninteractive preview 2516A with scroll controls, all within the samecover flow view. This same user interface for showing both initialpreviews and interactive previews may be used in a list view or iconview, such as a list view or icon view of files or folders from a searchresult or a list view or icon view of files and folders from within afile management software window (e.g. a Finder window).

FIG. 31 shows an example of a software architecture 3001 which may beused to dynamically generate previews, such as one or both of initialpreviews and interactive previews. This architecture may include one ormore APIs, such as API 3011 and optional API 3012 to act as an interfacebetween separate software programs. For example, API 3011 interfacesbetween a preview generator 3003, which may be a preview generatordaemon provided by an operating system software, and one or moreapplication programs 3007 (such as a file management software program ora search software program, etc.). The one or more application programs3007 make calls, through the API 3011, in order to have a previewgenerated for a file or other item in a particular view. The previewgenerator 3003 is configured to receive those calls to generate apreview of the content of the file. The preview of the content can begenerated by requesting a software routine (such as a first plug-in), ina set of software routines 3005, to generate either displayable contentor data in a standard format which can be converted by the applicationwhich made the call (or a helper application/plug-in or system resource)into displayable content. The first plug-in may be loaded and thenprocess the file (from the storage 3010 of files and data) to generatethe preview; the preview generator may determine the file type of thefile by making a call, to determine the file type, to the file systemsoftware 3009 which returns an identifier of the file type of the file,and then the preview generator 3003 may match the file type with themost appropriate routine in the set of routines before causing the mostappropriate routine to be loaded to generate the preview. Each softwareroutine may include data identifying the file types it can process, andthe preview generator matches the file type for the file, which was inthe call through API 3011, with the software routine which can processthat file type, based on the data identifying the file types it canprocess.

FIGS. 27A-27N provide an example of a preview or thumbnail which zoomsout first from a small thumbnail view to a full-screen view and backinto the small thumbnail view. This may occur though a continuous orsubstantially continuous animation or may occur in progressive,intermittent steps. In the case of a continuous or substantiallycontinuous animation, if the content is a movie which plays over timewith a sequence of related images, the movie may appear to play smoothlyand continuously as the thumbnail expands from the thumbnail 2603 or thethumbnail 2610A to the full-screen view shown in FIG. 27J. In this case,it will be understood that the animation may begin with the userinterface shown in FIG. 27A and proceed in series from FIG. 27A throughand including FIG. 27N. The animation may begin with the user placingthe cursor 2605 over the thumbnail in the cover flow view area 2318 andthen activating a command, such as pressing a button on a mouse orotherwise causing the system to display a play button, such as the playbutton 2609. In one embodiment, merely hovering the cursor over thethumbnail 2603 may cause the display of the play button 2609 within thethumbnail 2603 as shown in FIG. 27B. In alternative embodiments, theuser may select playback by selecting an option from a pull-down menu orby pressing a key on a keyboard, etc. The user may begin the playback ofthe thumbnail by selecting the play button 2609 while the cursor 2605 ispositioned over the play button as shown in FIG. 27B. In response, themovie begins to play and the play button turns into a stop button 2612.The movie may play as a small thumbnail, such as the thumbnail 2610A, ormay, in response to a user command or automatically in response to aplayback command, expand or zoom to a larger size. As noted above, thisexpansion or zooming out may occur in a smooth, continuous fashion andthe playback may occur and continue as the zooming occurs. FIG. 27Dshows the expansion/enlargement of the thumbnail to create an enlargedthumbnail 2610B which will continue to enlarge to become the thumbnails2610C and 2610D as shown in FIGS. 27E and 27F and 27G. As the thumbnailbecomes enlarged, while the movie continues to play back, a windowbegins to appear from behind the movie, wherein the window includes usercontrols, such as a “close” control 2614, “play” and other controls2616, and a full-screen control 2618. In one embodiment, the zoominganimation of the thumbnail's enlargement may stop at the stage shown inFIG. 26G and wait for further user input to either close the window(e.g. by activating the “close” user interface object 2614) or enlargeto full-screen mode by activating the user interface object 2618. Thethumbnail 2610D provides for playback of the movie and allows the userto modify the volume or the position of the current frame in the movieby using the volume control 2622 or the timeline 2620, respectively. Ifthe user selects full-screen mode, then the movie begins to enlargebeyond the size shown in FIG. 26G. This enlargement may again be smoothand continuous while the movie is playing. FIGS. 27H and 27I representtwo stages of such continuous enlargement from the window shown in FIG.26G. An example of full-screen mode is shown in FIGS. 27J and 27K. Theuser interface now includes a stop control 2632, a timeline control 2633which may be used to adjust the current playback position of the movie,and a reduce size control 2631 which may be used to return the moviefrom full-screen mode back to the thumbnail through a sequence, whichmay be continuous, beginning with the user interface shown in FIG. 26Jthrough the user interface shown in FIG. 27N.

Another aspect of the inventions described herein relates to the use ofanimation to display the contents of a folder. This aspect will be shownthrough the examples given in FIGS. 28A-30E. FIG. 28A shows an exampleof a method according to one embodiment which uses animations to displayat least a subset of icons representing files within a folder. Inoperation 2651, a data processing system displays an icon of a folder,the icon being at least partially transparent. FIG. 28C shows an exampleof a folder icon 2701 which is at least partially transparent, and FIG.30A shows an example of a folder icon 2751 which is also partiallytransparent. In operation 2653, the data processing system displays aset of icons at least partially within the icon of the folder. FIG. 28Cshows an example of icons, such as icons 2707, 2709, 2711, and 2713 atleast partially within the folder icon 2701. FIG. 30A shows anotherexample of a set of icons which are at least partially within the foldericon 2751; in this case, the icons are thumbnails or previews of thedocuments within the folder. In particular, the thumbnails or previews2757, 2758, 2759, and 2761 are shown at least partially within thetransparent folder icon 2751. These previews or thumbnails may begenerated dynamically (and stored temporarily in a cache for theanimation) as described above to show the actual content of each filerepresented by the thumbnail or preview, such as thumbnail 2757. Inalternative embodiments, the thumbnail or preview may be generated bythe application and stored in the file system as a preview for theparticular file and retrieved and used to provide the preview, such asthe thumbnail 2757. Referring back to FIG. 28A, operation 2655 involvesthe display by the data processing system of an animation of the set oficons to display at least a subset of the icons over a period of time.The animation may occur automatically without user interaction with theicon of the folder, such as the folder icon 2701, or may occur inresponse to user activity such as the selection of a command or inresponse to the user moving a cursor over the icon of the folder, suchas the folder icon 2701, etc. The animation may involve one or more of aset of changing user interfaces over time. For example, the animationmay include rotating, over time, the icons in the set of icons orshuffling, over time, the icons in the set of icons, or displayingmomentarily and sequentially each of the icons in the set of icons ordisplaying momentarily and sequentially a group of the icons in the setof icons or rearranging, over time, the icons in the set of icons. Aftera sufficient period of time, all of the icons within the folder can bedisplayed such that a user can, by watching the animation, determinewhich files are within the folder. It will be understood that the foldermay be a directory or folder in a hierarchical file system (HFS) whichis maintained by file system software and which interacts with filemanagement software such as the Finder or Windows Explorer. Theshuffling of icons may be similar to the shuffling of cards in a deck ofcards; this shuffling animation is shown in the sequence of imagesprovided by FIGS. 28C, 28D, 28E, 28F, and 28G. In these figures, theicons 2707, 2709, 2711, and 2713 appear to shuffle, one over the other,in a manner which is similar to cards in a deck of playing cards. In atleast certain embodiments, the icons may be displayed within the folder,such as folder icon 2701 or folder icon 2751, at different angles anddifferent orientations as shown in FIGS. 28C-28G and FIGS. 30A-30E. Thismay improve the visibility of the various icons such that more than oneicon can be seen within the folder, such as the folder icon 2701 or2751. The sequence of the shuffling of the icons may be random or may bein the order selected by a current sorting criteria, such as the name ofthe file or the date last used, etc. In certain embodiments, the foldericon, such as folder icon 2701 or 2751, may be displayed in any one ofan icon view (selected through activation of the icon view userinterface object 2330) or a list view, selected through activation ofthe list view user interface object 2331, or a column view, selected byactivation of the column view user interface object 2332, or even acover flow view, activated by selection of the cover flow view userinterface object 2333. Hence, for example, the animation within thefolder icon 2701, or the folder icon 2751, may appear in the cover flowview area 2318 to provide the user with an indication of the files anddocuments within a folder without even requiring the user to open thefolder into another view or window.

FIGS. 30A-30E illustrate the shuffling of thumbnails within a partiallytransparent folder which is the folder icon 2751. As shown in FIG. 30A,the thumbnail 2751 appears on top of the other thumbnails 2758, 2759,and 2761. Then, over time, the thumbnail 2758 appears on top of the restof the thumbnails 2759 and 2761 and 2757, as shown in FIG. 30B. Then,over time, as shown in FIG. 30C, the thumbnail 2759 appears on top ofthe other thumbnails 2757 and 2761. Then, over time, the thumbnail 2761appears on top of the other thumbnails, such as thumbnail 2757, which isbeginning to return to the top as can be seen in FIG. 20D. In FIG. 30E,the thumbnail 2763 is shown on top of the other thumbnails, includingthumbnail 2757, which is shown immediately behind the thumbnail 2763 asthe sequence of the shuffling is nearing completion. The animation, suchas the shuffling, may occur continuously over time or may occur oncethrough the entire sequence of files within the folder. The animationmay occur without user input automatically in response to displaying thefolder, or may occur in response to user input, such as positioning thecursor over the folder or hovering the cursor over the folder oractivating a command to cause the animation.

FIG. 28B represents an alternative method according to certainembodiments of the inventions. In operation 2671, the data processingsystem displays an icon of a folder which includes files in ahierarchical file system. The icon may be displayed in a file managementsoftware program, such as the Finder or Windows Explorer. In operation2673, the data processing system may then display automatically (e.g.without user interaction with the icon of the folder) an animationpresenting a content or representation of each of the files. This mayoccur in any one of the various views of a hierarchical file system,including a cover flow view, an icon view, a column view, or a list viewas described above. The animation may involve shuffling, or rotating, orthe other forms of animation described herein.

FIGS. 29F-29E represent another embodiment in which the folder animatesover time to indicate to the user the content of the folder. In thiscase, the folder may not be transparent but rather is opaque and theicon is displayed on the face of the folder over time. Hence, the faceof the folder begins as face 2751 and changes over time through faces2752, 2753, 2754, 2755.

In the foregoing specification, the invention has been described withreference to specific exemplary embodiments thereof. It will be evidentthat various modifications may be made thereto without departing fromthe broader spirit and scope of the invention as set forth in thefollowing claims. The specification and drawings are, accordingly, to beregarded in an illustrative sense rather than a restrictive sense.

1. A computer readable medium storing executable program instructionswhich when executed by a data processing system cause the dataprocessing system to perform a method comprising: displaying an icon ofa folder, wherein the icon of the folder is at least partiallytransparent to show icons at least partially within the folder;displaying a set of icons at least partially within the icon of thefolder.
 2. The medium as in claim 1 wherein the set of icons rotatewithin the icon of the folder to display, after a sufficient amount ofrotating, all viewable files in the folder, and wherein the folderrepresents a subdirectory in a hierarchical file system.
 3. The mediumas in claim 1 wherein the set of icons are animated to display at leasta subset of the icons over a period of time.
 4. The medium as in claim 2wherein a transparency of the folder is user selectable to be one of on,to be at least partially transparent, or off, to not be transparent, andwherein the rotating of the set of icons is user selectable to be on oroff.
 5. The medium as in claim 3 wherein the set of icons are animatedby at least one of: (a) rotating, over time, the icons in the set oficons; (b) shuffling, over time, the icons in the set of icons; (c)displaying momentarily and sequentially each of the icons in the set oficons; (d) displaying momentarily and sequentially a group of the iconsin the set of icons; (e) rearranging, over time, the icons in the set oficons; and wherein all of the icons in the set of icons in the folderare displayed after a sufficient period of time and wherein the iconsare at least one of (i) graphical images and (ii) thumbnails showingcontent of files represented by the icons.
 6. The medium as in claim 5wherein the set of icons are animated automatically without userinteraction with the icon of the folder and without user interactionwith the icons in the set of icons.
 7. The medium of claim 5 wherein theset of icons are animated in response to a user interaction with either(a) the icon of the folder or (b) an icon in the set of icons.
 8. Amachine implemented method comprising: displaying an icon of a folder,wherein the icon of the folder is at least partially transparent to showicons at least partially within the folder; displaying a set of icons atleast partially within the icon of the folder.
 9. The method as in claim8 wherein the set of icons rotate within the icon of the folder todisplay, after a sufficient amount of rotating, all viewable files inthe folder, and wherein the folder represents a subdirectory in ahierarchical file system.
 10. The method as in claim 8 wherein the setof icons are animated to display at least a subset of the icons over aperiod of time.
 11. The method as in claim 9 wherein a transparency ofthe folder is user selectable to be one of on, to be at least partiallytransparent, or off, to not be transparent, and wherein the rotating ofthe set of icons is user selectable to be on or off.
 12. The method asin claim 10 wherein the set of icons are animated by at least one of:(a) rotating, over time, the icons in the set of icons; (b) shuffling,over time, the icons in the set of icons; (c) displaying momentarily andsequentially each of the icons in the set of icons; (d) displayingmomentarily and sequentially a group of the icons in the set of icons;(e) rearranging, over time, the icons in the set of icons; and whereinall of the icons in the set of icons in the folder are displayed after asufficient period of time and wherein the icons are at least one of (i)graphical images and (ii) thumbnails showing content of filesrepresented by the icons.
 13. The method as in claim 12 wherein the setof icons are animated automatically without user interaction with theicon of the folder and without user interaction with the icons in theset of icons.
 14. The method of claim 12 wherein the set of icons areanimated in response to a user interaction with either (a) the icon ofthe folder or (b) an icon in the set of icons.
 15. A data processingsystem comprising: means for displaying an icon of a folder, wherein theicon of the folder is at least partially transparent to show icons atleast partially within the folder; means for displaying a set of iconsat least partially within the icon of the folder.
 16. A computerreadable medium storing executable program instructions which whenexecuted by a data processing system cause the data processing system toperform a method comprising: displaying an icon of a folder whichincludes files represented by icons, the files being in a hierarchicalfile system; displaying automatically, without user interaction with theicon of the folder, an animation presenting a content or representationof each of the files, wherein a subset of the files are shown after asufficient period of time.
 17. The medium as in claim 16 wherein theanimation presents the content or representation at least partiallywithin the icon of the folder.
 18. The medium as in claim 16 wherein theicon of the folder is not transparent and wherein the animation presentsthe content or representation on the face of the icon of the folder. 19.The medium as in claim 16 wherein the animation is at least one of: (a)rotating, over time, the content or representation of each of the files;(b) shuffling, over time, the content or representation of each of thefiles; (c) displaying momentarily and sequentially the content orrepresentation of each of the files; (d) displaying momentarily andsequentially a group of content or representations of the files; (e)rearranging, over time, the content or representations of each of thefiles and wherein the representations are icons showing graphical imagesand the content are thumbnails showing content of the files.
 20. Themedium as in claim 16 wherein the animation presents the content orrepresentation in a sequence determined by an order of sorting, which isuser selectable through at least one sorting user interface object. 21.The medium as in claim 5 wherein the set of icons are animated in asequence determined by an order of sorting, which is user selectablethrough at least one sorting user interface object.
 22. A machineimplemented method comprising: displaying an icon of a folder whichincludes files represented by icons, the files being in a hierarchicalfile system; displaying automatically, without user interaction with theicon of the folder, an animation presenting a content or representationof each of the files, wherein a subset of the files are shown after asufficient period of time.
 23. The method as in claim 22 wherein theanimation presents the content or representation at least partiallywithin the icon of the folder.
 24. The method as in claim 22 wherein theicon of the folder is not transparent and wherein the animation presentsthe content or representation on the face of the icon of the folder. 25.The method as in claim 22 wherein the animation is at least one of: (a)rotating, over time, the content or representation of each of the files;(b) shuffling, over time, the content or representation of each of thefiles; (c) displaying momentarily and sequentially the content orrepresentation of each of the files; (d) displaying momentarily andsequentially a group of content or representations of the files; (e)rearranging, over time, the content or representations of each of thefiles and wherein the representations are icons showing graphical imagesand the content are thumbnails showing content of the files.
 26. Themethod as in claim 22 wherein the animation presents the content orrepresentation in a sequence determined by an order of sorting, which isuser selectable through at least one sorting user interface object. 27.The method as in claim 12 wherein the set of icons are animated in asequence determined by an order of sorting, which is user selectablethrough at least one sorting user interface object.
 28. A dataprocessing system comprising: means for displaying an icon of a folderwhich includes files represented by icons, the files being in ahierarchical file system; means for displaying automatically, withoutuser interaction with the icon of the folder, an animation presenting acontent or representation of each of the files, wherein a subset of thefiles are shown after a sufficient period of time.